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FOREWORD 


This  document  Is  one  In  a  series  which  reports  on  research  conducted 
by  the  Behavioral  Sciences  Research  Center  at  Science  Applications.  Inc., 
under  Contract  No.  MDA  903-79-C-0699  with  the  U.S.  Army  Research  Institute 
for  the  Behavioral  and  Social  Sciences.  The  work  on  this  contract  has 
Involved  designing  and  developing  a  management  assessment  training  and 
simulation  system  (MATSS),  which  Includes  a  computer  simulation  called 
the  "Yugoslav  Dilemma."  used  to  assess  the  decision-making  strategy  used 
by  executive  level  managers.  Decision  making  has  been  found  to  be  one 
of  the  most  prevalent  factors  In  organizational  management.  The  major 
documents  produced  by  this  project  Include: 


Swezey,  R.  W.,  Streufert, -S.,  Criswell,  E.  L.,  Unger,  K.  W., 
and  van  Rijn,  P.  Development  of  a  computer  simulation  for 
assessing  decision-making  style  using  cognitive  complexity 
theory.  (SAI  Report  No.  SAI-84-04-178)  McLean.'  VA: 

Science  Applications,  Inc.,  1984. 

This  report  Is  the  project  final  report.  It  describes  the 
hlstorv  of  the  project,  theoretical  (cognitive  complexity 
theory)  rationale  for  the  simulation  and  Its  assessment 
measures,  and  a  complete  description  of  the  simulation. 

Interested  readers  should  refer  to  this  report  for  an  over¬ 
view  and  description  of  the  project. 

Baudhuln,  E.  S.,  Swezey,  R.  W.,  Foster,  G.  D.,  and  Streufert,  S. 

An  empirically  derived  taxonomy  of  organizational  systems. 

(SAT  Report  No.  SAI-80-091-178)  McLean,  VA:  Science 
Applications,  Inc.,  1980. 

This  document  describes  the  factor  analytic  procedures  used  to 
cluster  and  rank  order  over  350  variables  Involved  In  systems 
theory  and  organizational  management.  The  procedure  yielded  six 
factors.  Factor  one  was  multidimensional  Information  processing 
Including  decision  making.  This  factor  lead  to  the  decision¬ 
making  emphasis  of  the  MATSS  simulation. 

Swezey,  R.  W. ,  Davis,  E.  G. ,  Baudhuln,  E.  S.,  Streufert,  S.,  and 
Evans,  R.  A.  Organizational  and  systems  theories:  An  Integrated 
review.  (SAI  Report  No.  SAI-80-113-178)  McLean,  VA:  Science 
Applications,  Inc.,  1980. 

This  300-page  literature  review  provides  an  Integrated  discussion 
relating  the  diverse  fields  of  organizational  and  systems  theory. 
Its  contents  are  organized  according  to  the  taxonomy  developed  in 
Baudhuln,  Swezey*  Foster,  and  Streufert  (1980). 


Unger,  K.  W.  and  Swezey,  R.  W.  Programmer's  manual  to  accompany 
the  Yugoslav  dilemma  (a  computer  simulation)!  (SAI  Report  No. 
SAI-83-08-178)  McLean,  VA:  Science  Applications,  Inc.,  1983. 

This  manual  describes  the  eight  programs  which  run  the  Yugoslav 
Dilemma.  Each  program  is  listed  and  annotated.  Some  possible 
program  manipulations  are  described. 

Criswell,  E.  L.,  Unger,  K.  W.,  Swezey,  R.  W.,  and  Streufert,  S. 
Researcher's  manual  to  accompany  the  Yugoslav  dilemma  (a 
computer  simul ati on ) .  (SAI  Report  No.  SAI-84-02-178)  McLean , 

VA:  Science  Applications,  Inc.,  1984. 

The  manual  1)  explains  the  researcher's  responsibilities  in 
running  participants  through  the  simulation,  2)  describes  all 
materials  necessary  to  operate  the  simulation,  3)  provides  step- 
by-step  operating  procedures,  and  4)  presents  Instruction  for 
interpreting  participant  profiles. 

Criswell,  E.  L.,  Unger,  K.  W. ,  and  Swezey,  R.  W.  Participant's 
manual  to  accompany  the  Yugoslav  dilemma  (a  computer  simulation). 
(SAI  Report  No.  SA 1-84-03-1 78)  McLean,  VA:  Science  Applications, 
Inc.,  1984. 


This  manual  presents  1)  Instructions  on  how  to  Interact  with  the 
computer  during  the  simulation,  and  2)  fictional  background  informa 
tion  to  set  the  stage  for  the  Yugoslav  Dilemma. 


RESEARCHER'S  MANUAL  TO  ACCOMPANY  THE  YUGOSLAV  DILEMMA  (A  COMPUTER  SIMULATION) 
EXECUTIVE  SUMMARY 


Requirement: 

The  Yugoslav  Dilemma  is  a  computer  simulation  designed  to  assess  the  decision¬ 
making  style  of  high-level  managers  in  complex  situations.  Each  participant 
is  assisted  by  a  researcher.  The  Researcher's  Manual  documents  the  duties  of 
the  researcher. 

Procedures: 

The  contents  of  the  Researcher's  Manual  include  an  introduction,  prerequisites 
for  being  a  researcher,  researcher  responsibilities,  and  procedures.  The 
procedures  contain  step-by-step  instruction  for  1)  setting  up  and  running  the 
Yugoslav  Dilemma  and  the  Storm  scenario  practice  session,  and  2)  computer 
generation  of  participants'  decision-making  style  profiles.  Researchers  are 
also  taught  how  to  use  preliminary  unvalidated  norms  in  discussing  profiles 
with  participants. 

Findings: 

Given  experience  as  a  participant  and  the  Researcher’s  Manual,  the  researcher 
can  run  participants  through  the  Storm  and  Yugoslav  Dilemma  simulations  and 
tentatively  interpret  the  results  of  the  assessment. 

Use  of  Findings: 


The  Researcher's  Manual  is  a  necessary  tool  for  researchers  working  with  the 
Yugoslav  Dilemma. 
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1.  INTRODUCTION 


This  Researcher's  Manual  accompanies  the  computer  simulation.  "The  Yugoslav 
Dilemma."  This  manual  also  accompanies  the  Storm  simulation,  which  Is 
usually  used  as  a  practice  session  for  the  Yugoslav  Dilemma. 

The  goal  of  the  Yugoslav  Dilemma  Is  to  assess  a  participant's  "decision¬ 
making  style."  This  assessment  Is  thought  to  tell  if  a  participant.  In  a 
characteristic  way,  requests  and  acts  on  Information  when  conditions  are 
difficult  and  stakes  are  high.  This  assessment  Is  an  application  of  cog¬ 
nitive  complexity  theory.  See  Streufert  and  Swezey  (1982)  for  a  description 
of  cognitive  complexity  theory. 

As  a  researcher,  you  will  have  specific  responsibilities  which  are  discussed 
In  the  next  section.  Procedures  for  operating  the  simulation  and  Interpreting 
participants'  data  are  also  Included  In  this  manual. 

Prerequisites  for  being  a  researcher  Include: 

•  Be  a  participant  yourself. 

•  Be  thoroughly  familiar  with  the  Participant's  Manual 
(Criswell,  Unger,  and  Swezey,  1984). 

•  Thoroughly  read  this  manual. 

•  Verify  that  you  can  operate  the  computer  to  run  the 
simulation. 

% 

One  need  not  be  a  seasoned  computer  programmer  or  operator  to  function  as 
researcher.  This  Researcher's  Manual  Is  not  designed  to  teach  the  complexities 
of  the  programs  Involved.  See  Unger  and  Swezey  (1983)  for  program  details. 

At  this  point,  however,  some  computer  operating  guidelines  may  be  offered: 

•  The  J  symbol  must  be  showing  when  you  make  an  entry. 

•  The  ♦-  and  -►  keys  move  the  cursor  (□)  forward  and 
backward.  The  cursor  Indicates  your  present  location 
on  the  screen. 
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•  Check  your  typing.  If  you  enter  SIMYD.OBJ 
or  SIMYD.  OBJ  Instead  of  SIMYD.OBJ,  you  will 
get  an  error  measure. 

•  Find  the  CTRL  key.  This  control  key  works 
like  a  shift  key.  You  press  CTRL  and  another 
key  at  the  same  time.  This  key  commands  the 
computer;  it  does  not  type.  For  example.  If 
you  enter  CTRL  C  correctly,  you  will  not  see 
a  C  on  the  screen. 

•  Whenever  the  computer  says  PRESS  ANY  KEY  TO 
CONTINUE,  It  means  to  press  any  key  except 
CTRL,  SHIFT,  RESET,  or  REPT.  Pressing  any 
of  those  four  keys  has  no  effect.  However, 

If  you  press  CTRL  and  RESET  at  the  same  time, 
you  will  end  the  program;  so  do  not  press 
CTRL  and  RESET  at  the  same  time  unless  you 
want  to  end  the  program. 

•  If  you  have  a  problem,  hit  CTRL  and  RESET 

at  the  same  time.  This  produces  the  ]  symbol 
so  you  can  backtrack  and  start  entering  again. 

•  Call  an  expert  If  you  have  major  problems. 


Using  this  manual,  a  researcher  should  be  able  to  run  a  participant  through 
the  Storm  and  Yugoslav  Dllenma  simulations  and  generate  and  interpret  the 
participant's  decision-making  style  profile.  Should  major  computer  problems 
arise,  however,  the  researcher  will  need  to  call  a  computer  expert.  Make 
sure  all  programs  and  data  are  duplicated  on  floppy  disks  In  case  anything 
happens  to  the  floppy  or  hard  disks  during  a  session. 


Chapter  II  of  this  manual  lists  the  researcher's  responsibilities. 


Chapter  III  describes  all  the  materials  needed  to  run  participants  through 
the  Yugoslav  Dilemma  and  its  practice  session,  the  Storm  scenario. 

Chapter  III  also  Includes  a  suggested  room  arrangement  based  on  human 
factors  considerations. 


Chapter  IV  Includes  detailed,  step-by-step  Instruction  In  operating  each 
simulation.  For  each  simulation,  standard  and  alternate  operating  procedures 
are  given.  The  alternate  procedure  allows  a  researcher  to  select  certain 
parameter  values  whereas  the  standard  procedure  sets  all  parameters  for  the 


researcher.  Chapter  IV  introduces  program  changes  that  may  affect 
simulation  timing  and  information  load;  however,  programming  these 
changes  is  explained  in  Unger  and  Swezey  (1983). 

Chapter  V  provides  detailed  step-by-step  instruction  in  generating  decision¬ 
making  style  profiles.  The  researcher  is  taught  to  copy  data  files  from 
the  hard  to  the  floppy  disk  then  print  out  the  profile.  Chapter  V  also 
provides  preliminary  norms  and  information  about  interpreting  and  discussing 
a  profile.  This  information  takes  into  account  the  early  developmental  stage 
of  both  the  simulation  itself  and  the  measures  of  complexity  generated. 


II.  RESEARCHER  RESPONSIBILITIES 


Your  responsibilities  as  researcher  Include: 


•  Having  all  materials  ready  for  the  participant. 

•  Engaging  computer  so  that  the  simulation  will  begin. 

•  Briefing  the  participant;  answering  questions  as 
necessary  before  the  simulation  begins. 

•  Answering  participant  questions  as  necessary 
during  the  simulation;  assisting  participant 
with  computer  operating  problems  should  they 
develop. 

o  After  the  session,  operating  the  computer  to 
generate  the  participant's  decision-making 
style  profile. 

•  Reviewing  and  discussing  participant's  profile 
with  him  or  her. 


Figure  1  presents  the  sequence  of  events  for  the  researcher.  These 
events  are  all  described  in  this  manual. 


DAY  BEFORE 


Set  up  computer  room. 


Provide  Participant's  Manual  for  participant. 


STORM  SCENARIO 


Load  Storm  scenario. 


Brief  participant. 


After  participant  completes  simulation,  verify 
participant  knows  all  simulation  procedures. 


YUGOSLAV  DILEMMA 


Load  Yugoslav  Dilemma  simulation. 


Be  available  as  needed  while  participant  completes 
simulation. 


DECISION-MAKING 

PROFILE 


Generate  participant's  decision-making  profile: 

•  Rename  participant's  files  on  hard  disk. 

•  Copy  participant's  files  from  hard  disk 

to  floppy  disk  containing  profile  program, 
t  Print  out  participant’s  profile. 

•  Copy  participant's  files  to  a  storage  disk. 

•  Delete  participant's  files  from  profile 
program  floppy  disk  and  hard  disk. 


Discuss  profile  with  participant. 


Figure  1.  Researcher  activities. 
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III.  MATERIALS 


The  researcher  should  ensure  that  all  the  following  materials  (A  through  E) 
are  available  for  each  participant. 

A.  Computer  Equipment 

The  computer  equipment  used  to  run  the  simulation  includes: 

•  Apple  II  Plus  computer  (with  Apple  operating  manuals) 

•  Amdek  (or  comparable)  color  monitor  (with  operating 
manual ) 

•  Integral  Data  Systems  printer  with  grappler  Inter¬ 
face  (and  paper)  (with  operating  manual) 

•  Maezon  hard  disk  drive  (with  operating  manual) 
with  software  necessary  to  run  the  simulation 
(See  Unger  and  Swezey,  1983.) 

•  Apple  floppy  disk  drive 

•  Floppy  disk  labelled  "MSM" 

•  Floppy  disk  labelled  "PROFILE  1/84" 

The  floppy  disk  "MSM"  (for  Maezon  System  Manager)  Is  used  to 
activate  the  simulation  programs  which  are  stored  on  the  hard 
disk.  The  "PROFILE  1/84"  disk  Is  used  to  generate  participants' 
decision-making  style  profiles. 

B.  Participant's  Manual 

The  Participant's  Manual  Is  a  document  which  provides  basically 
two  types  of  Information  to  the  participant.  First,  the  manual 
provides  procedures  about  how  to  participate  In  the  simulation 
and  how  to  enter  responses  In  the  computer.  Second,  the  manual 
provides  political,  economic,  historic,  geographic,  and  military 
Information  as  background  to  the  Yugoslav  Dilemna.  THE  RESEARCHER 
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MUST  BE  COMPLETELY  FAMILIAR  WITH  THE  PARTICIPANT'S  MANUAL. 

THE  CONTENT  OF  THAT  MANUAL  IS  NOT  REPEATED  IN  THE 
RESEARCHER'S  MANUAL. 

C.  Decision  Alternatives 

Decision  alternatives  are  the  choices  of  action  available 
to  the  participant.  Each  scenario,  the  Yugoslav  Dilemma 
and  the  practice  session  for  that  dilemma  called  "Storm," 
has  its  own  set  of  decision  alternatives.  Decision 
alternatives  for  the  practice  session  Storm  are  listed  in 
the  Participant's  Manual  and  are  also  printed  separately 
on  one  sheet  of  paper  with  the  computer  code  number  for 
each  choice.  They  are  also  contained  in  Appendix  A  of 
this  document. 

•  #• 

Decision  alternatives  for  the  Yugoslav  Dilemma  are  listed 
in  the  Participant's  Manual  and  are  also  printed  in  a 
pamphlet  with  four  two-sided  pages.  They  are  also  con¬ 
tained  in  Appendix  B  of  this  document. 

D.  Note- taking  Form 

The  participant  uses  this  form  to  keep  track  of  messages 
received  and  action  taken.  Participants  are  not  required 
to  use  this  form,  but  an  adequate  number  of  copies  (50  to  100) 
should  be  available.  This  form  appears  In  Appendix  C. 

Detailed  Instructions  regarding  Its  use  are  contained  in  the 
Participant's  Manual. 

E.  Maps 

One  map  is  required  for  the  Storm  scenario.  The  map  has 
grid  squares  which  are  labelled  by  their  x,  y  coordinates. 
During  the  scenario,  the  participant  may  need  to  enter  Into 
the  computer  the  location  of  people  or  things.  The  computer 


Is  programmed  to  accept  and  use  only  those  coordinates  from 
the  scenario  map.  If  a  participant  incorrectly  enters  a 
coordinate,  the  computer  gives  an  error  message  and  Instructs 
the  participant  to  enter  a  two-letter  x  coordinate  and  a  one 
or  two-digit  y  coordinate.  These  coordinates  must  be  obtained 
from  the  scenario  map. 

Several  different  maps  of  Yugoslavia  are  available  although 
only  one  is  required  for  participation.  The  required  map  is 
the  hand-drawn  map  of  the  Yugoslav  region  with  grid  squares. 

Each  grid  square  may  be  named  by  using  Its  x,  y  coordinates. 

As  with  the  Storm  scenario,  the  Yugoslav  Dilemma  simulation 
is  programmed  to  accept  and  use  only  coordinates  obtained 
from  the  scenario  map.  Other  maps  available  are  commercially 
prepared  maps  of  the  world  and  the  Yugoslav  region. 

Appendix  D  contains  the  maps  required  for  the  Storm  and 
Yugoslav  Dilemma  simulations. 

Room  Arrangement 

Figure  2  presents  a  suggested  room  arrangement  (for  right-handed 
participants). 

Figure  2  shows  a  table  with  large  workspace.  A  large  desk 
(approximately  six  feet  long  and  three  feet  wide)  will  have 
enough  table  space  to  hold  all  the  equipment  and  provide 
clear  workspace.  Maps  may  be  hung  on  the  adjacent  left  wall 
within  the  participant's  eyesight. 

The  printer  may  be  located  on  the. left  of  the  table.  The 
front  of  the  printer  (the  side  with  the  label)  should  face 
the  front  edge  of  the  table.  The  printouts  should  be  easily 
within  the  participant's  reach,  and  there  should  be  room  for 
the  printout  to  stack  on  the  table,  not  on  the  floor. 


Figure  2.  Recommended  room  arrangement 


The  video  monitor  should  sit  on  top  of  the  Apple  computer 
with  the  computer  near  the  center  of  the  front  edge  of  the 
table. 

The  floppy  disk  drive  should  sit  on  top  of  the  hard  disk  drive. 

The  floppy  disk  drive  cable  is  short,  so  both  disk  drives  must 
be  close  to  the  back  of  the  Apple.  The  front  sides  of  the  disk 
drives  point  away  from  the  Apple  and  sit  perpendicular  to  the 
Apple.  This  arrangement  accommodates  short  cable  length  and 
leaves  an  area  clear  for  workspace. 

Table  space  to  the  right  of  the  Apple  is  workspace.  This  space 
should  be  large  enough  for  the  participant  to  store  the  materials 
and  write  on  the  note-taking  forms. 

Ambient  lighting  is  important.  To  the  extent  possible,  use  the 
following  guidelines  for  ambient  lighting  (Davis  and  Swezey,  1983) 

•  Diffuse  rather  than  direct  lighting  should  be 
used.  Direct  lighting  may  cause  glare,  fatigue, 
and  decreased  visual  efficiency. 

•  Reduce  glare  by  using  several  low  intensity 
light  sources  rather  than  one  high  intensity 
light  source. 

•  Dull  colors  should  be  used  on  workspace. 

•  Light  colored  walls  are  recommended. 

•  Place  hood  or  shield  over  monitor  if 
necessary  to  reduce  glare. 

Chair  comfort  and  table  height  are  also  important.  To  the  extent 
possible,  use  the  following  guidelines  for  chair  and  table  (Davis 
and  Swezey,  1983): 


•  Seat  width  minimum  is  18  inches. 


IV.  SIMULATION  PROCEDURES 


This  chapter  presents  step-by-step  Instructions  for  running  the  Storm  scenario 
and  the  Yugoslav  Dilemma. 

The  Storm  scenario  Is  a  brief  practice  session.  Its  purpose  Is  to  familiarize 
the  participant  with  1)  how  to  enter  responses  Into  the  computer,  and  2)  how 
simulations  progress.  Because  the  Storm  scenario  Is  just  practice,  the 
participant  should  go  through  It  quickly.  The  participant  should  follow 
the  step-by-step  exercise  In  the  Participant's  Manual,  but  encourage  the 
participant  not  to  get  bogged  down  —  the  actual  decisions  made  do  not  matter. 
The  computer  stores  response  data,  but  no  assessment  of  decision-making 
style  will  be  made  using  the  Storm  scenario. 

The  Yugoslav  Dllenna  takes  data  on  participants'  decisions  and  assesses 
decision-making  style.  It  usually  takes  three  to  six  hours  for  a 
participant  to  complete  the  simulation. 

Section  A  of  this  chapter  provides  step-by-step  procedures  for  operating 
the  Storm  practice  session.  Section  B  gives  procedures  for  the  Yugoslav 
Dllemna.  For  each  simulation,  there  are  two  operating  procedures;  a 
standard  run  and  an  alternate  procedure. 

A.  The  "Storm"  Practice  Scenario 

The  Storm  scenario  may  be  run  using  either  one  of  two  procedures 
depending  on  whether  the  researcher  wants  to  specify  certain 
parameter  values.  The  parameters  that  may  be  specified  are: 

•  Long  or  short  form  Instructions  to  participants. 

•  Use  of  printer  and  which  type  interface. 

•  Participant  code  name. 

•  Display  of  minute  markers. 
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If  you  wish  to  set  the  parameters  yourself,  see  Section  A3 
("Alternate  Steps  IS  and  16  Change  Parameter  Values").  The 
parameters  are  explained  In  Section  A3. 

The  standard  run  procedure  sets  all  parameters  for  you.  The 
default  values  (given  in  Section  A3  below)  for  the  parameters 
will  be  useful  In  running  most  participants. 

To  run  the  Storm  scenario,  follow: 

•  Steps  1-21  Set  Up  the  Computer  (Substitute 
Steps  18  and  19  with  Alternate  Steps  18  and 
19  if  you  set  your  own  parameter  values.) 

•  Steps  22-27  Run  the  Scenario 


1 .  Steps  1-21  Set  Up  the  Computer 


Step  1.  Check  that  all  computer  equipment  is  connected 
and  plugged  in.  Call  an  expert  if  you  have 
questions. 

Step  2.  Open  front  door  on  floppy  disk  drive  by  gently 
pulling  the  door  straight  forward  and  up. 

Step  3.  With  your  thumb  and  forefinger,  grasp  the 

floppy  disk  labelled  MSM  by  the  label.  Keep 
the  label  facing  up  and  away  from  you.  Take 
care  not  to  touch  the  disk  anywhere  but  on 
the  label  or  else  the  disk  may  be  ruined. 

Step  4.  Insert  the  disk  into  the  disk  drive.  (The 
non-labelled  edge  goes  in  first.)  When  the 
disk  is  in,  you  will  hear  a  click. 

Step  5.  Close  the  door  on  the  disk  drive. 

Step  6.  Turn  the  Apple  on.  The  switch  is  on  the 

back  of  the  Apple  on  the  left.  If  the  room 
is  arranged  following  the  Figure  1  sketch, 
it  is  easier  to  reach  around  and  with  your 
left  hand  feel  for  the  switch  than  it  is 
to  walk  around  behind  the  computer  and 
look  for  the  switch.  Switch  to  "on"  and 
you  will  hear  a  bleep  and  the  disk  drive 
whirl. 
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Step  7.  Turn  the  monitor  on  by  pulling  the  "On/Vol" 
knob  located  on  the  right  side  of  the  front 
of  the  monitor. 

Step  8.  Adjust  monitor  contrast  by  turning  the 

"Contrast"  knob  located  under  the  "On/Vol" 
knob. 

Step  9.  You  will  see 


DOS  VERSION  3.3  08/25/80 

Apple  II  PtUS  OR  ROMCARD  SYSTEM  MASTER 

Run  □ 


Step  10.  To  turn  on  the  printer,  there  are  two  switches. 

The  "On-Off"  switch  Is  on  the  back  upper  left 
corner  of  the  printer.  When  you  switch  "On," 
a  red  light  "PWR"  appears  on  the  front  upper 
right  side  of  the  printer.  Over  the  red  light 
you  will  see  two  red  Indicators.  Move  the 
left  Indicator  to  ONLINE.  A  red  light  below 
It  will  come  on.  The  right  Indicator  stays 
straight  up. 

Make  sure  plenty  of  paper  Is  loaded  In  the 
printer.  To  load  the  printer,  follow  Instruc¬ 
tions  In  the  printer  manual  or  call  an  expert. 

NOTE:  If  you  are  not  using  a  printer,  you 
should  follow  the  ALTERNATE  operating  procedures 
In  Section  III. 3  below. 

Step  11.  Now  you  will  run  a  program  on  the  floppy  disk  to 
activate  the  programs  on  the  hard  disk.  (You  will 
load  the  hard  disk  later.)  Type  HH  (but  do  not 
press  RETURN). 

Step  12.  Press  the  white  switch  on  the  front  of  the  hard  disk 
drive  on  the  "write  enabled"  side  (the  right  side). 

Step  13.  The  next  two  bulleted  tasks  must  be  done  quickly  In 
sequence,  so  please  read  the  Step  13  directions 
completely  before  completing  the  tasks. 


*  \  • .  • .  • . 
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•  Find  the  hard  disk  drive  "Off-On"  switch 
and  switch-on  the  hard  disk  drive.  The 
switch  is  on  the  back  of  the  hard  disk 
drive  on  the  top  right  comer.  (The 
connecting  cable  comes  from  the  top  left 
comer  on  the  back  side.)  If  the  room 

Is  arranged  following  the  Figure  1  sketch* 

It  may  be  easy  for  you  to  feel  with  your 
right  hand  for  the  switch. 

•  Press  RETURN  on  the  Apple. 

You  will  hear  the  hard  disk  whirl;  the  old  screen 
disappears  and  a  new  one  appears.  If  you  turn  on 
the  hard  disk  before  you  type  HH  RETURN,  the  hard 
disk  drive  will  make  a  loud  rattle.  If  this  hap¬ 
pens,  quickly  switch  off  the  hard  disk,  and  try 
again. 

Step  14.  The  new  screen  is: 


HARD  DISK  READY 
MSM  (Y/N)?0 


Type  In  N.  You  will  then  see  the  ]  symbol. 


Step  15.  Type  EXEC  STORM, V030 
Press  RETURN 
You  will  see  ] 


Step  16.  In  a  few  seconds  you  will  see 


ENTER  SIMULATION  VALUES 
ENTER  D#,P#: 

ALL  MOVES  SUCCESSFUL?  (Y/N):D 

PRINTER?  (P,G,N):D 

PRINTER?  (P,G,N):D 
ENTER  PARTICIPANT  CODE: 

ENTER  SCENARIO: 

DISPLAY  MINUTE  MARKERS?  (Y/N):Q 

NEW  OR  RESTART?  (N/R):D 
NEW  OR  RESTART?  (N/R):n 


You  simply  wait  about  30  seconds  while  the 
scenario  on  the  hard  disk  is  loading.  You 
will  see  the  boxes  on  the  screen  blinking. 

Step  17.  After  the  scenario  is  loaded,  you  will  see 


PRESS  1  TO  BEGIN 


You  press  J  (SHIFT  and  the  number  1). 


Step  18.  Next  you  will  see 


You  press  any  key 


Step  20.  Next  you  will  see 


GENERAL  INSTRUCTIONS  FOR  PARTICIPATING 
WILL  BE  PRESENTED  ON  THE  COMPUTER. 

PLEASE  REFER  TO  THE  PARTICIPANTS  MANUAL 
FOR  DETAILED  INFORMATION. 

PRESS  ANY  KEY  TO  CONTINUE. 


You  press  any  key. 

Step  21.  Next  you  will  see  a  full  color  graphic  with 
the  title  MATSS  above  a  puzzled  decision¬ 
maker.  . 

•  •• 

[NOW  YOU  BRING  THE  PARTICIPANT  INTO  THE 
ROOM.  WE  DO  NOT  WANT  THE  PARTICIPANT  TO 
SEE  THE  SCREEN  DISPLAYED  IN  STEP  16.] 


2.  Steps  22-27  Run  the  Storm  Scenario  Session 

The  researcher  may  complete  Steps  1-21  before  the  participant 
arrives.  If  there  are  any  computer  problems,  they  may  be  taken 
care  of  before  the  participant  arrives.  When  the  participant 
arrives.  Instructions  should  be  given,  as  outlined  in  Step  22 
below. 

Step  22.  a.  Greet  participant,  have  him  or  her  sit 
down  at  the  table. 


.v;- 


m 

k.""*  *  * 


WC3 


b.  Explain  that  he  or  she  will  be  working 
on  two  computer  simulations  Involving 
crisis  situations  in  which  he  or  she 
will  make  decisions  and  take  action. 

c.  Explain  that  the  first  simulation  is  a 
brief  practice  session,  called  "Storm." 
The  purpose  of  "Storm"  is  to  familiarize 
the  participant  with  the  computer  and 
with  procedures  for  making  decisions. 


d.  Inform  the  participant  that  during  the 
second  simulation,  the  Yugoslav  Dilemma, 
the  computer  will  take  data  on  his  or  her 
decisions  or  reactions  during  the  simula¬ 
tion.  Those  data  will  be  compared  to 
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other  participants'  data  for  the 
purpose  of  determining  what  reaction 
pattern(s)  or  "decision-making  styles" 
the  participant  used  during  the  simu¬ 
lation.  Assure  the  participant  such 
things  as  intelligence  or  aggressive 
tendency  are  not  being  tested.  Tell 
the  participant  that  after  the  simu¬ 
lation,  the  computer  will  generate  a 
profile,  and  you  will  discuss  the 
profile.  Tell  the  participant  that 
the  simulation  is  not  validated  and 
is  highly  experimental. 

e.  Provide  agenda  (all  approximate  times). 

60  minutes  -  Read  Participant's  Manual. 

30  minutes  -  Practice  Storm  simulation. 

60  minutes  -  Part  I  Yugoslav  Dilemma. 

15  minutes  -  Break. 

60  minutes  -  Part  II  Yugoslav  Dilemma. 

15  minutes  -  Break. 

60  minutes  -  Part  III  Yugoslav  Dilemma. 

30  minutes  -  Debriefing. 

NOTE:  Participants  may  read  their 
manuals  on  their  own  time  before 
reporting  to  the  session.  Breaks 
last  as  long  as  you  wish. 

f.  Answer  questions  about  the  Participant's 
Manual.  Encourage  participant  to  practice 
the  step-by-step  exercise  In  the  Partici¬ 
pant's  Manual  during  the  Storm  scenario. 

g.  Provide  note-taking  forms,  decision 
alternatives,  maps,  and  pencils  for  the 
Storm  scenario. 

Step  23.  The  screen  from  Step  21  is  displayed.  The  parti¬ 
cipant  now  follows  the  direction  on  that  screen 
and  presses  any  key  to  continue.  The  partici¬ 
pant  may  now  be  left  alone  providing  all  materials 
(Participant's  Manual,  decision-making  alternatives, 
maps,  note-taking  forms,  pencils)  are  available. 

Step  24.  Next,  three  text  frames,  one  graphic  frame,  and 
eight  text  frames  follow.  (These  frames  are 
described  in  the  Participant's  Manual.)  The 
participant  advances  each  frame  by  pressing  any 
key. 
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Step  25.  The  participant  then  receives  the  following 
screen: 


TIME  1200:00 

2  APR  1985 

HIT  1  TO  START  SIMULATION. 

To  hit  !,  the  participant  presses  SHIFT  and  1  (one) 
at  the  same  time. 

Step  26.  The  participant  goes  through  the  Storm  simulation. 

The  researcher  may  be  needed  if  the  computer  mal¬ 
functions.  The  participant  should  refer  to  his 
or  her  Participant's  Manual  for  the  answer  to 
most  questions. 

Step  27.  After  the  session,  verify  that  the  participant 
knows: 

•  Use  of  decision  alternatives 

•  Use  of  note- taking  form 

•  Use  of  computer  printout 

t  How  to  enter  decisions 

•  How  to  enter  planned  future  decisions 

•  How  to  enter  previous  messages 

a  How  to  enter  previous  decisions 

•  Time  compression  and  progression 

ALL  THIS  INFORMATION  IS  CONTAINED  IN  THE  PARTICI¬ 
PANT'S  MANUAL  AND  HAS  NOT  BEEN  DUPLICATED  IN  THIS 
MANUAL.  Additional  information  about  time  com¬ 
pression  Is  presented  in  Section  V  of  this  manual. 
If  the  participant  has  completed  the  step-by-step 
exercise  in  the  Participant's  Manual,  he  or  she 
Is  probably  ready  to  participate  In  the  Yugoslav 
Dilemma. 


3.  Alternate  Steps  15  and  16  Change  Parameter  Values 


As  mentioned  earlier,  the  standard  run  procedure  sets 
parameter  values  for  you.  The  list  of  these  default 
parameter  values  follows: 

ENTER  D#,P#:-1,-1 
ALL  MOVES  SUCCESSFUL?  N 
PRINTER?  G 

ENTER  PARTICIPANT  CODE:  (left  blank) 

ENTER  SCENARIO:  STORM 
DISPLAY  MINUTE  MARKERS?:  N 
NEW  OR  RESTART?  N 

(An  explanation  of  the  parameters  Is  given  below.) 

The  alternate  run  procedure  allows  the  researcher  to 
change  parameter  values.  An  explanation  of  the  param¬ 
eters  follows. 

For  the  alternate  run  procedure: 

•  Follow  Steps  1  through  14  above. 

•  The  following  screen  Is  displayed: 


HARD  DISK  READY 
MSM  (Y/N)? 


Now  go  to  Alternate  Step  15  below. 

ALT  Step  15.  a.  Type  BLOAD  RUNTIME, V030 
Press  RETURN 
3  Is  displayed 


b.  Type  BLOAD  SIMSTORM.OBJ 
Press  RETURN 
3  Is  displayed 


c.  Type  MAXFILES  2 
Press  RETURN 
3  is  displayed 


d.  Type  CALL  6064 
Press  RETURN 
3  Is  displayed 
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AIT  Step  16.  Answer  the  next  seven  questions  (a-g): 


ENTER  D#,P#:-1,1 

Press  RETURN 

(runs  long  form  of  instruc¬ 
tions  to  participants 
throughout  simulation  - 
See  Appendix  E  for  text 
of  instructions.) 

or 

ENTER  D#,P#:1 ,-l 

Press  RETURN 

(runs  long  form  of  instruc¬ 
tions  through  the  first 
decision,  then  runs  short 
form  of  instructions 
throughout  simulation) 

or 

ENTER  D#,P#:1 ,1 

Press  RETURN 

(runs  long  form  of  instruc¬ 
tions  In  first  period,  then 
runs  short  form  through 
remainder  of  simulation) 

or 

ENTER  D#,P#:-1 ,-l 

Press  RETURN 

(runs  short  form  of  instruc¬ 
tions  throughout  simulation) 

ALL  MOVES  SUCCESFUL  (Y/N)  N 
(Do  NOT  press  RETURN) 

(Y  option  is  not  used  in  this 
most  current  version  of  the 
simulation;  see  Unger  and 
Swezey  (1983)  for  changes 
necessary  to  use  this  option) 

PRINTER?  (P.G.N):  G 

or 

(for  grappler  Interface; 
presently  used  with  Integral 
Data  Systems  445  printer) 

PRINTER?  (P.G.N):  P 

or 

PRINTER?  (P.G.N):  N 
(Do  NOT  press  RETURN) 

(for  other  parallel  inter¬ 
face  cards) 

(for  no  printer) 

ENTER  PARTICIPANT  CODE:  NAME 
Press  RETURN 

(type  in  code  name) 

ENTER  SCENARIO:  STORM 

Press  RETURN 
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f.  DISPLAY  MINUTE  MARKERS?  (Y/N):  N 


or 

DISPLAY  MINUTE  MARKERS?  (Y/N):  Y 

Minute  markers  are  the  two  right¬ 
most  digits  on  the  first  line 
(the  ''time"  line)  of  screens 
appearing  during  the  simulation. 

The  first  of  these  two  digits 
counts  real  time  minutes  of 
elapsed  simulation  time.  The 
second  number  tells  the  real 
time  minute  of  elapsed  simula¬ 
tion  time  during  which  the  next 
message  can  appear.  Normally, 
minute  markers  are  not  displayed 
for  participants  because  we  do 
not  want  them  to  f 1 gure  out  when 
the  next  message  is  coming. 

g.  NEW  OR  RESTART?  (N/R):  N  (for  new  session) 

or 

NEW  OR  RESTART?  (N/R):  Y  (to  continue  previously 

begun  session;  ignore 
coding  on  the  screen 

Now  you  are  back  at  Step  17.  after  you  type  Y) 

The  Yugoslav  Dilemma  Scenario 


The  Yugoslav  Dilemma  may  be  run  using  either  one  of  two  pro¬ 
cedures  depending  on  whether  the  researcher  wants  to  specify 
certain  parameter  values.  The  parameters  that  may  be 
specified  ere: 


e  Long  or  short  form  Instructions  to  participants. 

•  Use  of  printer  and  which  type  Interface, 
e  Participant  code  name. 

•  Display  of  minute  markers. 


If  you  wish  to  set  the  parameters  yourself,  see  Section  B3 
("Alternate  Steps  3  through  5  Change  Parameter  Values").  These 
parameters  are  explained  in  Section  B3. 
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The  standard  run  procedure  sets  all  parameters  for  you.  The 
default  values  (given  In  Section  B3  below)  for  the  parameters 
will  be  useful  In  running  most  participants. 

To  run  the  Yugoslav  01 lemma,  follow: 

•  Steps  1-6  Prepare  to  Run  the  Simulation 
(Substitute  Steps  3,  4,  and  5 
with  Alternate  Steps  3,  4,  and 
5  If  you  set  your  own  parameter 
values.) 

9  Steps  7-11  Run  the  Simulation 

After  the  participant  completes  the  simulation,  refer  to 
Chapter  V  for  procedures  on  generating  and  discussing  the 
decision-making  profile. 


1*  Steps  1-6  Prepare  to  Run  the  Simulation 


-Step  1.  Before  beginning  the  Yugoslav  Dilemma,  each 
participant  should  have  1)  read  the  Parti¬ 
cipant's  Manual,  and  2)  gone  through  the 
Storm  scenario.  Storm  scenario  procedures 
are  contained  in  this  manual. 

Step  2.  If  the  computer  Is  on  and  If  the  participant 
has  just  completed  the  Storm  scenario,  press 
CTRL  and  RESET  at  the  same  time.  You  will 
see  the  ]  symbol. 

or 

If  the  computer  Is  off,  complete  Steps  1 
through  14  above  (under  Procedures,  Practice 
Session).  At  the  end  of  Step  14,  you  will 
see  the  ]  symbol. 

Step  3.  Type  EXEC  YO,V030 
Press  RETURN 

You  will  see  ] 
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You  simply  wait  about  five  (5)  minutes 
while  the  simulation  Is  loading.  You 
will  see  the  boxes  on  the  screen  blinking. 

Step  5.  After  the  simulation  Is  loaded*  you  will  see 


PRESS  !  TO  BEGIN 


You  press  !  (SHIFT  and  1). 

Step  6.  Next  you  will  see  a  U.S.  flag. 

[NOW  YOU  BRING  THE  PARTICIPANT  INTO  THE 
ROOM.  WE  DO  NOT  WANT  THE  PARTICIPANT 
TO  SEE  THE  SCREEN  DISPLAYED  IN  STEP  4.] 

2.  Steps  7-9  Run  the  Simulation 


Step  7.  If  all  materials  (Participant's  Manual* 
decision  alternatives*  pencils*  maps, 
note- taking  forms)  are  available*  the 
participant  may  now  be  left  alone. 
After  the  U.S.  flag*  comes  two  more 
graphic  frames  and  six  frames  of  text. 
The  participant  advances  each  frame  by 
pressing  any  key.  (These  frames  are 
described  In  the  Participant's  Manual.) 
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Step  8.  The  participant  then  receives  the 
following  screen: 


TIME  -  0800:00 

12  JUL  1988 

HIT!  TO  START  SIMULATION 

To  hit  1,  the  participant  presses  SHIFT 
and  1  at  the  same  time. 


Step  9.  The  participant  continues  through 

the  simulation.  The  researcher  will 
direct  the  participant  when  to  end 
the  simulation. 

The  researcher  now  continues  with 
procedures  In  Section  V,  Assessment 
of  Decision-making  Style. 

3.-  Alternate  Steps  3-5  Change  Parameter  Values 


As  mentioned  earlier,  the  standard  run  procedure 
sets  parameter  values  for  you.  The  list  of  these 
default  parameter  values  follows: 

ENTER  D#,P#:-1,-1 
ALL  MOVES  SUCCESSFUL?  N 
PRINTER?  6 

ENTER  PARTICIPANT  CODE:  (left  blank) 

ENTER  SCENARIO:  YUGOSLAV  DILEMMA 
DISPLAY  MINUTE  MARKERS?:  N 
NEW  OR  RESTART?  N 

(An  explanation  of  the  parameters  Is  given  below.) 

The  alternate  run  procedure  allows  the  researcher  to 
change  parameter  values.  An  explanation  of  the 
parameters  follows. 

For  the  alternate  run  procedure: 

•  Follow  Steps  1  and  2  above. 


•  The  screen  id  11  look  like  (or  be  similar  to): 


t  Now  go  to  ALT  Step  3  below. 


ALT  Step  3.  a.  Type  BLOAD  RUNTIME, V030 
Press  RETURN 


b.  Type  BLOAD  SIMYD.OBJ 
Press  RETURN 

c.  Type  MAXFILES  2 
Press  RETURN 

d.  Type  CALL  6064 
Press  RETURN 


ALT  Step  4.  Answer  the  next  seven  questions  (a-g): 


ENTER  D#,P#:-1,1 
Press  RETURN 


ENTER  D#,P#:1,-1 
Press  RETURN 


ENTER  D#,P#:1,1 
Press  RETURN 


ENTER  D#,P#:-1,-1 
Press  RETURN 


b.  ALL  MOVES  SUCCESSFUL  (Y/N) 


(runs  long  form  of  Instruc¬ 
tions  to  participants 
throughout  simulation  - 
See  Appendix  E  for  text 
of  Instructions.) 

(runs  long  form  of  Instruc¬ 
tions  through  the  first 
decision,  then  runs  short 
form  of  Instructions 
throughout  simulation) 

(runs  long  form  of  instruc¬ 
tions  In  first  period,  then 
runs  short  form  through 
remainder  of  simulation) 

(runs  short  form  of  Instruc¬ 
tions  throughout  simulation) 

(Y  option  is  not  used  in  this 
most  current  version  of  the 
simulation) 


27 


B 


S- 


s; 

1 

c.  PRINTER?  (P,6,N):  G 

(for  grappler  interface; 
presently  used  with 

Integral  Data  Systems 

445  printer) 

or 

ft 

PRINTER?  (P»G,N):  P 

(for  other  parallel 
interface  cards) 

< 

•4  , 

•V 

or 

I 

/• 

•» 

PRINTER?  (P.G.N):  N 

(for  no  printer) 

1 

v  ,* 

d.  ENTER  PARTICIPANT  CODE:  NAME 

Press  RETURN 

(type  In  code  name) 

j 

f 

>:• 

e.  ENTER  SCENARIO:  YUGOSLAV  DILEMMA 
Press  RETURN 

i 

| 

■- 

f.  DISPLAY  MINUTE  MARKERS?  (Y/N):  N 

ft 

or 

• 

JC" 

■V 

v' 

DISPLAY  MINUTE  MARKERS?  (Y/N):  Y 

■ 

£ 

f-: 

;.v 

A 

A. 

Os 

►  . . 

1 

% 

:? 

Minute  markers  are  the  two  right¬ 
most  digits  on  the  first  line 
(the  "time"  line)  of  screens 
appearing  during  the  simulation. 
The  first  of  these  two  digits 
counts  real  time  minutes  of 
elapsed  simulation  time.  The 
second  number  tells  the  real 
time  minute  of  elapsed  simu¬ 
lation  time  during  which  the 
next  message  can  appear. 

Normally,  minute  markers  are 
not  displayed  for  participants 
because  we  do  not  want  them  to 
figure  out  when  the  next  message 

Is  coming. 

* 

* 

1 

* 

• 

] 

1 

< 

* 

»"* 

■  - 
•  * 

g.  NEW  OR  RESTART?  (N/R):  N 

(for  new  session)  ! 

IV 

or 

• 

«' 

NEW  OR  RESTART?  (N/R):  Y 

(to  continue  a  previous 
session)  ] 

x> 

£ 

r>. 


I 


vlv:-.-:-: 


\v 
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ALT  Step  5.  About  five  minutes  later,  the  following 
screen  appears: 

WELCOME  TO  THE  YUGOSLAV  DILEMMA 
PRESS  THE  I  KEY  TO  BEGIN 


You  press  the  1  key. 

Now  you  are  back  at  Step  6  of  the  standard 
run  procedure  and  may  continue  on  from  there. 


4.  Simulation  Timing 


a.  Progression 

The  "time''  Tine  found  above  each  frame  In 
the  simulation  looks  like  the  sample  below: 


TIME  ■  2050:00  _  J_2_JULY  J_988 _ _4_6 

IF  YOU  WISH  TO  MAKE  A  DECISION.  HIT  THE 
•D'  KEY. 


Four  kinds  of  time  are  Involved  In  the 
simulation: 

•  Real  time 

•  Simulation  time  of  day 

•  Simulation  time 

•  Real  minutes  of  simulation  time 

Real  time  Is  the  time  that  Is  measured 
by  normal  clocks  and  watches.  The  com¬ 
puter  does  not  keep  track  of  real  time. 
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Simulation  time  of  day  Is  given  in  hours 
and  minutes  (seconds  are  always  00).  In 
this  example,  the  time  is  20  hours  50 
minutes,  or  8:50  pm. 

In  both  simulations,  simulation  time  pro¬ 
gresses  one  hour  for  every  30  seconds  of 
real  time.  Thus,  In  30  real  time  seconds, 
the  simulation  time  of  day  shown  In  the 
example  above  will  be  2150.  (Interrup¬ 
tions  to  this  time  progression  are  noted 
In  4C  below.) 


Real  minutes  of  simulation  time  are  real 
time  minutes  counted  only  while  simula¬ 
tion  time  progresses.  The  Storm  scenario 
has  one  period  of  nine  real  minutes  of 
simulation  time.  Because  simulation 


time  does  not  progress  during  decisions, 
the  real  time  length  of  the  session  varies 
depending  on  how  long  the  participant 
spends  making  decisions  and  entering  plans. 
If  the  participant  makes  no  decisions,  the 
Storm  scenario  will  last  nine  real  minutes. 


In  simulation  time,  however,  18  hours  pass 
in  the  Storm  scenario. 


The  Yugoslav  Dilemma  has  three  periods, 
each  with  30  real  minutes  of  simulation 
time.  Again,  real  time  elapsed  varies 
depending  on  how  long  the  participant 
spends  making  decisions  and  entering  plans. 
If  the  participant  makes  no  decisions,  the 
scenario  will  last  90  real  minutes.  In 
simulation  time,  2.5  days  elapse  in  each 
period  and  there  are  7.5  days  in  the  total 
dilemma. 


The  ratio  of  real  time  to  simulation  time 
elapsed  is  set  in  the  LEDIT  program.  Under 
the  present  program,  the  time  multiplier  is 
120  which  means  that  120  simulation  seconds 
pass  for  each  second  of  real  lime,  or  one 
hour  of  simulation  time  for  every  30  seconds 
of  real  time. 


LEDIT  also  stores  the  day,  month,  and  year 
of  the  beginning  of  each  scenario.  The  date 
progresses  with  simulation  time  and  Is  dis¬ 
played  in  the  center  of  the  "time"  line.  In 
the  screen  above,  the  date  is  July  12,  1988. 

The  researcher  may  modify  the  real -to- 
simulated  time  ratio  and  the  day,  month,  and 
year  of  scenario  origin  using  the  LEDIT  pro¬ 
gram.  Use  of  LEDIT  Is  discussed  In  Unger 
and  Swezey  (1983). 
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As  mentioned  earlier  (in  IV.A.3.f  above), 
minute  markers  may  be  displayed  on  the 
"time"  line.  If  displayed,  they  are  the 
two  right-most  digits  on  the  time  line. 

In  the  screen  above,  the  minute  markers 
are  4  and  6. 

The  first  digit  counts  real  time  minutes 
of  elapsed  simulation  time.  This  marker 
is  a  real  time  clock  and  need  not  have 
Its  value  changed. 

The  second  digit  displays  the  real  time 
minute  of  elapsed  simulation  time  at 
which  the  next  message  will  be  displayed. 
This  marker  is  related  to  the  Information 
load  value  used.  Load  values  may  be  mani¬ 
pulated  and  changes  In  load  value  will  be 
reflected  in  the  second  minute  marker. 
Manipulating  load  Is  discussed  in  Section 
IV. 4. b  below. 

b.  Information  Load 

Information  load  refers  to  the  number  of 
messages  presented  to  the  participant 
per  real  time  minute  of  simulation  time. 
There  are  two  types  of  messages,  fixed 
and  responsive.  Fixed  messages  do  not 
address  a  participant's  Inquiries,  but 
responsive  messages  specifically  address 
a  participant's  action. 

Presently,  information  load  is  fixed  (not 
free  to  vary  depending  on  a  participant's 
responses),  but  load  has  different  values 
in  different  parts  of  the  simulations.  In 
the  Storm  scenario,  one  message  is  delivered 
every  three  real  minutes  of  elapsed  simula¬ 
tion  time.  For  periods  one,  two,  and  three 
of  the  Yugoslav  Dilemma,  the  values  are 
1  message/3  minutes,  1  message/6  minutes, 
and  1  message/2  minutes,  respectively. 

Presently,  a  minimum  number  of  fixed 
messages  per  period  Is  programed.  Table  1 
shows  the  minimum  number  of  fixed  messages 
by  period.  For  example,  during  period  two 
of  the  Yugoslav  Dlleimia,  a  fixed  message 
Is  always  delivered  as  the  third  and  fourth 
message.  If  responsive  messages  are  due, 
they  will  be  delivered  as  the  first,  second, 
and  fifth  messages.  If  no  responses  are 
due,  a  fixed  message  will  be  delivered 
each  time.  However,  If  a  response  is  due. 

It  will  be  delivered  Instead  of  the  fixed 
message.  Information  load  Is  fixed. 
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TABLE  1 


TOTAL  NUMBER  OF  MESSAGES  AND 
MINIMUM  NUMBER  FIXED  MESSAGES 
DELIVERED  BY  SIMULATION  PERIOD 


Scenario 

Number  of 

Messages 

Delivered 

Mandatory 
Fixed  Message 
Numbers 

Storm 

3 

1 

Yugoslav  Dilemma: 

Period  1 

10 

1,  5,  9,  10 

Period  2 

5 

3,  4 

Period  3 

15 

2,  6,  7,  9,  1 

Other  message  distributions  are  possible 
with  program  changes.  The  timing  of  fixed 
and  responsive  messages  may  be  manipulated 
using  the  TEDIT  and  DEDIT  programs.  Use 
of  these  programs  is  described  in  Unger 
and  Swezey  (1983). 

Interruptions 

When  the  participant  makes  a  decision,  the 
simulation  clock  stops.  The  clock  remains 
stopped  until: 

§  The  decision  is  executed. 

•  Any  future  planned  decisions 
are  entered. 

•  Any  previous  decisions  made 
while  current  action  was  planned 
(which  lead  to  current  action) 
are  entered. 

t  Any  previous  messages  which  lead 
to  current  action  are  entered. 

When  the  participant  re-enters  the  scenario, 
the  simulation  clock  progresses  one  hour. 
This  value  may  be  changed  using  the  LEDIT 
program.  See  Unger  and  Swezey  (1983). 

Because  the  simulation  time  stops  during 
decision  times,  total  length  of  session  in 
real  time  cannot  be  predicted.  Real  time 
session  duration  Increases  with  time  spent 
making  decisions  and  entering  plans. 


V.  ASSESSMENT  OF  DECISION-MAKING  STYLE  PROCEDURES 


This  chapter  provides:  1)  step-by-step  procedures  for  generating  a 
participant's  decision-making  profile,  2}  information  on  interpreting 
the  profile,  and  3)  information  on  the  decision-making  styles  of  subject 
matter  experts. 


A.  Computer  Generation  of  the  Profile 


To  obtain  the  profile,  follow: 


•  Steps  1-7  Rename  Files 

•  Steps  8-22  Copy  Files  from  Hard  to  Floppy  Disk 

•  Steps  23-28  Generate  the  Profile 

•  Steps  29-31  Profile  Printout 

1.  Filing  System 


The  decision-making  style  profile  is  generated  using 
the  PROFILE. OBJ  program.  The  program  requires  that 
the  printer  be  operational. 

As  outlined  in  preceding  sections,  the  Yugoslav  Dilemma 
may  be  activated  using  a  standard  procedure  or  an  alter¬ 
nate  procedure.  You  may  recall  that  if  the  standard 
procedure  was  used,  the  participant's  data  are  stored 
under  no  name;  the  default  for  participant  code  name  is 
blank.  Thus,  the  participant's  data  should  be  renamed 
before  copying  to  the  floppy  disk.  If  two  sets  of  files 
have  the  same  code  name,  or  have  blank  code  names,  the 
subsequent  set  will  replace  the  older  set  if  stored  on 
the  same  disk. 

Data  for  each  participant,  regardless  of  procedure,  are 
stored  in  three  files  on  the  hard  disk.  For  the  standard 
run  procedure,  the  three  files  are  named: 


If  the  alternate  procedure  is  used,  the  files  are  named: 

A/PARTICIPANT  CODE 
R#/PARTICIPANT  CODE 
R/PARTICIPANT  CODE 

To  use  the  PROFILE. OBJ  program,  the  three  participant's  data 
files  must  be  copied  from  the  hard  disk  to  the  floppy  disk 
which  contains  the  PROFILE. OBJ  program.  (The  PROFILE. OBJ 
program  is  on  a  disk  labelled  PROFILE  1/84;  it  is  not  on 
the  MSM  disk.) 


2.  Steps  1-7  Rename  Files  on  Hard  Disk 

Follow  Steps  1-7  if  your  files  have  no  participant  code 
(from  standard  run  procedures)  or  if  you  want  to  change 
the  code  name.  Be  sure  to  use  the  same  name  for  all  three 
files. 

Step  1.  Hard  disk  drive  must  be  on.  (Ifitis  not 
on,  follow  Steps  1-14  under  Storm  scenario 
procedures,  then  go  to  Step  2  below. 

Step  2.  Type  CTRL  and  RESET  at  the  same  time. 

]  will  appear. 

Step  3.  Type  CATALOG, V032 

You  will  see  the  list  of  participant  files 
contained  on  the  hard  disk. 

Step  4.  Rename  all  three  files. 

Type  RENAME  A/OLD  CODE, A/ NEW  CODE 
(Leave  one  blank  space  for  OLD  CODE 
If  code  is  blank.) 

Press  RETURN 

Step  5.  Type  RENAME  R#/0LD  C0DE,R#/NEW  CODE 
Press  RETURN 

Step  6.  Type  RENAME  R/OLD  CODE.R/NEW  CODE 
Press  RETURN 

Step  7.  Type  CATALOG 
Press  RETURN 

Check  the  catalog  and  see  that  your 
renaming  has  taken  place. 
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3.  Steps  8-22  Copy  Files  from  Hard  Disk  (Volume  32)  to 
ribppy"bi‘sk~D5ROFILE  1/64) 

Step  8.  Hard  disk  drive  should  be  on.  If  It  Is 
on,  go  on  to  Step  9  below.  If  not, 
follow  Steps  1-14  under  Storm  scenario 
procedures. 

Step  9.  Type  EXEC  HFID.V001 
Press  RETURN 

Step  10.  Screen  displays: 


MENU 

1  through  9 


WHICH  WOULD  YOU  LIKE?  □ 


Type  0 
Press  RETURN 

Step  11.  This  step  Identifies  the  floppy  disk  volume. 
Screen  displays  0  ■  □ 

Type  1  (Do  not  press  RETURN.) 

Screen  displays  D  *  1  V 
Type  254 
Press  RETURN 

Step  12.  This  step  Identifies  the  hard  disk  volume. 
Screen  displays  D  ■  1  V  ■  254 
D-D 

Type  2  (Do  not  press  RETURN.) 

Screen  displays  D  ■  2  V  -  □ 

Type  032 
Press  RETURN 

Step  13.  Screen  displays  D  -□ 

Press  RETURN 

Step  14.  This  step  selects  copy  function. 

Screen  displays  MENU 
Type  1 

Press  RETURN 


(0  option  not 
listed  on  menu.) 


Step  15.  This  step  Identifies  source  as  the  hard  disk. 
Screen  displays  SOURCE  SLOT?  n 
Type  6 
Press  RETURN 

Screen  displays  DRIVE?  □ 

Type  2 
Press  RETURN 

Step  16.  This  step  Identifies  floppy  disk  as  destination. 
Screen  displays  DESTINATION  SLOT?  □ 

Type  6 

Press  RETURN 

Screen  displays  DRIVE? 

Type  1 

Press  RETURN 


Step  17.  Screen  displays  FILENAME? 

Type  “/PARTICIPANT  CODE 
Press  RETURN 

Step  18.  Screen  says  "DO  YOU  WANT  PROMPTING?" 
Type  N 
Press  RETURN 

Step  19.  Screen  says  "INSERT  DISKS." 

Remove  MSM  disk  from  floppy  disk  drive 
Insert  PROFILE  1/84  disk 
Close  disk  drive  door 
Press  any  key  to  continue 

Step  20.  Now  the  computer  searches  for  each  file. 
First  It  finds  A/PARTICIPANT  CODE. 

After  the  file  Is  copied,  DONE  appears 
on  the  screen. 

Then  It  copies  R#/ PARTI Cl PANT  CODE, 
then  R/PARTICIPANT  CODE. 


(Use  one  blank  space 
or  the  code  if  code 
Is  blank.) 


If  your  file  has  already  been  copied  or 
if  your  files  have  the  same  name  as 
another  file  on  the  floppy  disk,  the 
computer  will  say  TYPE  IN  A  NEW  FILE 
NAME  FOR  THE  COPY  OR  (RETURN)  to  REPLACE 
EXISTING  FILE  OR  (CTRL-C)  (RETURN)  TO 
CANCEL  COPY.  You  follow  directions  as 
necessary. 


If  your  floppy  disk  Is  full,  you  should 
copy  excess  data  files  onto  another  disk. 

To  do  this,  follow  procedures  In  the  Apple's 
DOS  Manual  under  FID  program.  You  will  avoid 
filling  up  the  PROFILE  disk  by  copying  all 
data  files  to  another  disk  Immediately  after 
you  generate  each  profile  as  described  In 
Section  6  below. 
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Once  the  participant  files  are  copied  onto  the 
floppy  disk  labelled  PROFILE  1/84,  you  may  pro¬ 
ceed  to  generate  the  profile. 

Step  23.  Disk  labelled  PROFILE  1/84  In  disk  drive. 
Type  PR#6 
Press  RETURN 

The  screen  displays  a  message  and  the 
]  symbol. 

Step  24.  Type  BRUN  DOS  MOVER 
Press  RETURN 

You  will  hear  the  floppy  disk  whirl,  and 
a  message  and  the  ]  symbol  appear. 

Step  25.  Type  BLOAD  RUN  TIME 
Press  RETURN 

You  will  hear  the  floppy  disk  whirl, 
and  the  ]  symbol  appears. 

Step  26.  Type  BRUN  PROFILE.OBJ 
Press  RETURN 

Step  27.  The  following  screen  appears: 


PROGRAM  MEASURE 
ENTER  PARTICIPANT  CODE: 


.V-.'-.' v 
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If  standard  run  procedure  generated  the 
data  files,  press  RETURN. 

or 

If  alternate  procedure  generated  the 
data  files,  type  CODE  (whatever  the 
code  was),  press  RETURN. 

Step  28.  The  screen  asks  DATA  LIST?  (Y/N) 

If  you  want  the  profile  printout  to 
Include  all  measures  In  the  profile 
plus  data  regarding  each  Individual 
decision  the  participant  made,  type  Y. 

or 


*.% 


If  you  want  the  profile  to  Include 
all  measures  without  Individual 
decision  data,  type  N. 


5.  Steps  29-31  Profile  Printout  *  •• 

Step  29.  The  computer  begins  printing.  The 
following  Information  Is  printed: 

•  Number  of  minutes  In  simulation 

e  Number  of  messages 

e  Number  of  decisions 

e  Number  of  periods 

e  List  of  decisions  and  decision 
data  (if  DATA  LIST?  Y  was  entered) 

t  Number  of  categories 

e  Lfst  of  14  measures  for  each 
period 

(There  may  be  brief  pauses  (about  a  minute) 
during  printing.  If  so,  length  of  pauses 
varies  directly  with  length  and  complexity 
of  the  participant's  session.) 

When  the  printout  is  complete,  the  screen 
displays  the  ]  symbol. 

Step  30.  If  you  want  to  generate  another  profile. 
Type  BRUN  PROFILE. OBJ 
Press  RETURN 

Go  back  to  Step  27  above; 

Otherwise,  go  on  to  Step  31. 


Step  31.  To  advance  the  printout  so  you  can  tear 
It  off  the  Integral  Data  Systems  445 
printer: 

•  Hove  the  left  red  indicator  on 
the  front  right  side  of  the 
printer  from  ONLINE  to  PAPER. 

•  Move  the  right  red  indicator 
towards  the  right  (towards  LF 
for  line  feed). 

(For  other  printers,  refer  to  the  printer 
manual  for  directions.) 

•  Release  the  line  feed  indicator 
when  a  perforation  in  the  paper 
appears  above  the  paper  holder. 

•  Tear  off  the  printout. 


6.  Steps  32-34  Permanent  Storage 

It  is  suggested  that  participant  files  be  stored  permanently 
on  a  floppy  disk  or  on  a  dedicated  volume  of  the  hard  disk, 
and  deleted  from  hard  disk  Volume  032  and  the  PROFILE  floppy. 
This  prevents  you  from  ever  getting  a  DISK  FULL  message  in 
the  middle  of  a  session.  Therefore,  after  generating  the 
profile,  it  Is  suggested  that  you: 

Step  32.  Copy  files  from  the  PROFILE  disk  elsewhere  for  storage. 

Step  33.  Delete  files  from  Volume  032  on  the  hard  disk. 

Step  34.  Delete  files  from  the  PROFILE  floppy  disk. 

To  copy  files  from  the  PROFILE  disk  to  a  volume  of  the  hard 
disk,  follow  copy  procedures,  described  in  Steps  8-22  above 
(source  drive  will  be  1,  destination  drive  will  be  2).  To 
copy  to  another  floppy,  follow  procedures  outlined  in  the 
Apple  DOS  Manual  under  FID  program. 

To  delete  files  from  the  hard  disk: 

•  Activate  the  hard  disk  (see  Steps  1-14 
under  Storm  scenario  procedures) 

•  Type  CATALOG, V032 
Press  RETURN 

The  contents  of  volume  032  will  be  displayed. 
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Press  RETURN  again  and  again  if  necessary 
to  display  all  contents.  When  all  contents 
have  been  displayed,  the  ]  symbol  appears. 

e  Write  down  the  file  names  you  can  delete. 
(If  you  are  at  all  uncertain  about  what 
to  delete,  call  an  expert.) 

•  For  each  file  to  be  deleted: 

Type  DELETE  FILENAME 
Press  RETURN 

•  After  you  delete  all  unnecessary  files, 
type  CATALOG,  press  RETURN,  and  check 
that  you  have  deleted  correctly. 

To  delete  files  from  the  PROFILE  disk: 

$  Insert  PROFILE  disk  into  drive  1 

e  Type  PR#6 

•  Type  CATALOG,  press  RETURN 

•  Type  DELETE  FILENAME  and  press  RETURN 
for  each  file  to  be  deleted 

•  Type  CATALOG,  press  RETURN  to  check 
that  you  have  been  deleted  correctly. 


7.  Step  35  Turn  Off  the  Computer 
Step  35.  To  turn  off  the  computer: 

•  Switch  the  hard  disk  off. 

•  Push  the  Apple  video  monitor 
knob  off. 

o  Switch  the  Apple  computer  off. 

•  Switch  the  printer  off  using 
the  switch  on  the  left  back 
of  the  printer. 

• 


Store  disks  in  jackets. 


B.  Interpreting  the  Profile 


After  the  researcher  generates  the  participant's  profile,  the 
researcher  and  participant  engage  in  discussion.  This  discussion 
Includes  five  topics: 

•  Purpose  of  the  simulation 

•  Decision-making  styles 

•  Components  of  the  printout 

•  Participant's  decision-making  strategy 
(or  strategies) 

•  Expert  strategies 

The  researcher  should  use  the  information  in  this  section  as  the 
basis  for  the  discussion. 

1.  Purpose  of  the  Simulation 

The  Yugoslav  Dilemma  was  designed  to  measure  decision¬ 
making  style.  Style  refers  to  the  process  or  structure 
of  the  decisions,  not  to  the  quality  or  success  of  the 
decisions. 

Decisions  made  do  not  affect  the  outcome  of  the  simula¬ 
tion.  Two  types  of  messages  are  delivered:  fixed  and 
responsive.  Fixed  messages  do  not  address  participant 
action,  but  they  unfold  the  scenario.  Responsive 
messages  answer  the  participant's  action,  but  still  do 
not  change  the  course  of  the  dilemma.  War  cannot  be 
prevented  or  encouraged  by  the  participant. 

Participants  react  differently  to  the  news  that  the 
simulation  has  no  outcome.  Some  are  Indifferent;  some, 
relieved;  and  some  participants  are  chagrined  to  hear 
that  their  hard  work  on  the  dilemma  could  not  have 
changed  its  course. 
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While  explaining  the  purpose  of  the  simulation 
during  the  debriefing,  you  may  ask  the  partici¬ 
pant  not  to  discuss  the  simulation  with  potential 
participants.  Advance  knowledge  that  the  simula¬ 
tion's  outcome  cannot  be  affected  by  participant 
action  may  discourage  some  participants  from 
trying  to  solve  the  dilemma. 

The  simulation  data  provide  information  about 
the  decision  structure  or  strategy  used  by  a 
participant  confronted  with  a  difficult,  complex, 
critical,  ill-defined  problem.  It  is  important 
to  make  the  distinction  between  structure  and 
content. 

All  of  us  make  decisions  nearly  all  of  the 
time.  Most  of  these  decisions  are  minor,  are 
based  on  previously  established  habits;  we 
may  not  even  be  aware  that  we  have  just  made 
a  decision.  An  example  of  a  minor  decision 
might  be  whether  or  not  to  jog  to  some  specific 
mailbox  or  wait  to  mail  the  letter  until  we 
find  another  more  convenient  mailbox.  Decisions 
are  different  In  their  content;  the  decision 
where  to  mail  a  letter  and  whether  to  have  a 
sandwich  or  a  salad  for  lunch  differ  greatly. 

As  a  result.  It  Is  difficult  to  scientifically 
analyze  decision  content  unless  we  restrict 
ourselves  to  some  limited  range  of  decisions. 

For  example.  If  mailing  the  letter  at  a 
distant  mailbox  and  having  a  salad  for  lunch 
are  all  related  to  health  (jogging  to  the  mail¬ 
box  and  eating  fewer  calories),  then  we  may 
have  some  basis  for  judging  the  content  of  the 
decisions.  For  most  decisions  made  on  a  day- 
to-day  basis,  however,  contents  are  so  diverse 
that  qualitative  comparisons  are  difficult  to  make. 
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Decision  structure.  In  contrast  to  content,  pro¬ 
vides  an  opportunity  for  scientific  study.  The 
structural  approach  considers  how  decisions  are 
made  rather  than  what  decisions  are  made.  In 
determining  the  "how"  of  decision-making,  we  can 
analyze  whether  decisions  are  meaningfully  related 
in  a  strategy,  to  how  many  goals  they  relate,  and 
whether  the  decision  maker  conceptualizes  the  task 
setting  in  terms  of  some  overall  interactive  system 
or  operates  on  several  unrelated  subsystems.  To 
determine  the  structure  which  underlies  a  decision 
maker's  functioning,  several  measures  relating  to  a 
participant's  performance  have  been  developed.  This 
information  is  contained  on  the  printout. 


Decision-making  Style 


The  Yugoslav  Dilemma  was  designed  to  assess  the 
decision-making  structure  used  by  a  participant 
in  the  dilemma.  Using  the  dilemma,  It  is  possible 
to  categorize  participants'  data  into  three  different 
structures  or  styles.  These  three  decision-making 
types  are  based  on  an  interactive  complexity  theory 
of  Information  processing  (Streufert  and  Streufert, 
1978,  1981). 


Complexity  theory  Is  concerned  with  Information 
processing  from  a  structural  vantage  point.  It 
focuses  on  the  decision-making  environment  and 
on  the  decision-making  process  within  an  organism. 
That  organism  might  be  a  person,  a  decision¬ 
making  group,  an  organization,  or  organizational 
component.  Information  is  received,  analyzed 
(or  "differentiated"),  matched  to  stored  informa¬ 
tion  (such  as  attitudes,  beliefs.  Intents,  goals, 
plans,  or  strategies),  and  finally,  decisions  are 
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made.  Complexity  theory  is  not  concerned  with 
what  specific  decisions  are  made,  but  is  concerned 
with  how  the  decision  makers  or  the  organization 
arrived  at  the  decisions. 

The  three  decision-making  styles  identified  by  the 
Yugoslav  Dilemma  are  categorized  according  to  the 
simplicity  or  complexity  of  the  planning  strategy 
employed  and  the  degree  to  which  diverse  bits  of 
information  (called  dimensions)  are  or  are  not 
combined  or  integrated  Into  a  strategy. 

The  three  styles  of  decision  making  assessed  by 
the  Yugoslav  Dilemma  are: 

•  Uni  dimensional 

t  Multi dmenslonal  differentiatlve 

•  Multidimensional  Integrative 

Within  multidimensional  Integrative  style,  both 
low-level  and  high-level  Integrators  may  be 
Identified.  Theoretical  discussions  of  the  terms 
above  may  be  found  in  other  documents  (for  example, 
Streufert  and  Swezey,  1982).  The  descriptions  below 
simplify  the  theoretical  definitions  and  use  every¬ 
day  terms  to  the  extent  possible. 

A  person  employing  uni  dimensional  decision-making 
style  bases  judgments  on  one  categorized  aspect 
or  dimension  (such  as  good  versus  bad)  of  the 
thing  or  event,  is  not  apt  to  consider  shades  of 
meaning,  and  usually  does  not  consider  multiple 
aspects  of  the  thing  or  event  being  judged.  For 
example,  a  unidimensional  person  might  describe 
a  "conflict"  as  a  bad  occurrence,  would  probably 
not  describe  conflict  as  healthy  under  certain 
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conditions,  and  would  probably  not  consider 
aspects  of  a  conflict  other  than  good  or  bad 
(such  as  solvable  -  not  solvable,  long-standing  - 
recent,  impacting  one  person  -  many  people,  etc.). 

Should  any  additional  considerations  be  made,  they 
would  likely  be  related  to  good  or  bad,  such  as 
very  good,  terrible,  or  slightly  bad. 

The  actions  of  a  unidimensional  person  tend  to  be 
in  direct  response  to  environmental  events  and  less 
(or  not  at  all)  in  response  to  any  plan  the  person 
may  have  formulated.  Strategy  is  not  characteristic 
of  a  unidimensional  decision  maker.  If  a  strategy 
is  used,  it  is  usually  a  "plan  not  to  plan." 

It  is  not  "bad"  to  be  a  unidimensional  decision  maker. 

The  style  is  not  correlated  with  intelligence,  and 
many  uni  dimensional  decision  makers  are  highly 
intelligent.  We  all  make  countless  decisions  every 
day,  and  to  a  large  extent,  complex  strategies  for 
making  decisions  are  not  required  and  may  even  be 
harmful  for  most  daily  decisions.  In  complex  situa¬ 
tions,  such  as  the  Yugoslav  Dilemma,  however,  multi¬ 
dimensional  or  more  complex  strategies  probably 
characterize  the  decision-making  structure  of  military 
experts.  We  will  be  able  to  determine  optimal  strategies 
as  work  on  the  simulation  continues.  Nevertheless,  it 
is  Important  to  note  that  one  style  is  not  worse  than 
others.  Each  style  Is  optimal  in  certain  environments. 

In  contrast  to  a  unidimensional  person,  a  multidimen¬ 
sional  decision  maker  usually  considers  many  aspects 
or  dimensions  of  the  thing  or  event,  and  also  considers 
shades  of  meaning.  Within  multidimensional,  the  style 
of  multidimensional  differentiators  is  characterized 


by  differentiation,  or  consideration  of  many 
different  dimensions  of  a  thing  or  event,  but 
not  by  integration  or  the  formation  of  a  summary 
judgment  based  on  all  dimensions  considered.  The 
differentiator  may  view  the  dimensions  as  unrelated 
or  even  mutually  exclusive.  Some  differentiators 
generate  an  inordinate  number  of  considerations 
(or  dimensions)  about  a  thing  or  event  and  differ¬ 
entiate  into  finer  and  finer  subdimensions.  This 
may  delay  or  even  prevent  any  conclusions  (or 
integrations)  from  being  drawn. 

The  decision-making  style  of  differentiators  is 
not  characterized  by  strategic  planning.  Although 
this  person  may  consider  multiple  dimensions  or 
aspects  of  the  event,  generally  these  aspects  are 
not  integrated.  Where  strategy  occurs,  it  probably 
is  not  well -developed,  but  would  occur  more  frequently 
than  for  unidimensional  persons. 

The  style  of  multidimensional  Integrators  contains 
strategy.  The  Integrator,  like  the  differentiator, 
usually  considers  many  dimensions  of  a  thing  or  event; 
but  unlike  the  differentiator,  sees  relationships 
between  dimensions  and  forms  summary  opinions  (or 
integrations)  based  on  multiple  dimensions.  The 
Integrator,  unlike  the  differentiator,  may  cease 
considering  new  dimensions,  make  a  decision  (integra¬ 
tion),  and  then  begin  again  to  collect  new  information. 
In  addition,  an  Integrator  may  employ  one  or  more 
dimensions  as  rules  or  procedures  In  combining  sets 
of  decisions. 

Within  multidimensional  integrators,  the  simulation 
may  be  used  to  distinguish  low-  and  high-level  inte¬ 
grators.  The  integrations  of  a  low-level  integrator 
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typically  last  a  short  time,  and  the  Integrations 
are  not  woven  into  other  integrations.  High-level 
integrators,  on  the  other  hand,  execute  long-term 
and  complex  plans.  As  mentioned  earlier.  It  is  not 
automatically  "good"  to  be  a  multidimensional 
Integrator.  That  structure  Is  beneficial  in  some 
situations,  but  not  in  all.  A  multidimensional 
integrator  may  have  difficulty  making  the  myriad 
of  simple  decisions  we  all  make  every  day. 

3.  Components  of  the  Printout 

The  printout  contains  31  pieces  of  data.  These  are 
listed  in  Table  2.  As  shown  in  Table  2,  10  of  the 
31  items  are  used  to  classify  a  participant's 
decision-making  as  unidimensional,  multidimensional 
differentlatlve,  or  multidimensional  Integrative. 
The  other  Items  describe  the  simulation  run  In 
general  and  Individual  decisions  in  detail. 

A  description  of  the  printout  for  a  sample 
participant  named  "Complex  Test"  appears 
below.  A  copy  of  the  entire  printout  appears 
in  Appendix  F. 
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1.  Participant  code 

2.  ^timber  of  minutes  In  simulation 

3.  Number  of  messages 

4.  Number  of  decisions 

5.  Number  of  periods 
For  each  decision: 

6.  Computer  file  Identification 

7.  Decision  text 

8.  Real  time  minutes  of  simulation 

time  of  decision 

9.  Period  of  decision 

10.  Number  of  messages  preceding  decision 

11.  Decision  number  in  sequence 

12.  Simulation  time  of  decision 

13.  Decision  code  number 

14.  Future  decision  codes 

15.  Decision  numbers  of  decisions  on 

which  present  decision  based 

16.  Message  numbers  of  messages  on 

which  present  decision  based 

17.  Number  and  list  of  decision  categories 

used  in  total  simulation 

For  each  period: 


18.  Number  of  decisions 

19.  Number  of  respondent  decisions 

20.  Number  of  decision  categories  used 

21.  Number  of  forward  Integrations 

22.  Multlplexlty  F 

23.  Weight 

24.  Number  of  backward  Integrations 

•Note,  therefore,  that  Measure  No.  19  Is  employed  In  two  ways: 
1}  by  Itself,  and  2)  In  combination  with  Measure  I 25. 
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TABLE  2.  MEASURES  ON  PROFILE  AND  MEASURES  USED  FOR  CLASSIFICATION.  CONTINUED 


DATA  ON  PROFILE  PRINTOUT 


DATA  USED  FOR  CLASSIFICATION 


25.  Number  of  unintegrated  respondent 

decisions 

26.  Quality  of  integration  strategies 

(QIS) 

27.  Weighted  QIS 

28.  Average  response  speed 

29.  Number  of  serial  connections 

30.  Number  of  planned  but  not  executed 

integrations 

31.  General  unintegrated  decisions 


In  combination  with  #19 

X 

X 


In  combination  with  #21 
X 
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Profile: 

ENTER  PARTICIPANT  CODE: 
COMPLEX  TEST 

DATA  LIST?  (Y/N):Y 

NUMBER  OF  MINUTES  IN  SIMULA 
T ION: 74 


NUMBER  OF  MESSAGES-24 
NUMBER  OF  DECISIONS-38 
NUMBER  OF  PER20DS-3 


Next,  If  data  list  option  was  selected*  decision  data  for  each  decision 
made  are  printed  out  as  follows: 


R1 /COMPLEX  TEST 

YOUR  DECISION  TO  REDUCE  CREDIT  TO  YUGOSLAVIA  BY  1  MILLION  DOLLARS 
ei-28>25@ 

TIME-32.5 

PERIOD-2  MESSAGES- I 2 

DECISION  NUMBER-17  TIME-06/18  21;53j38 

(;D1331 .1 ) 

FUTURE  DECISIONS: (;D1211.1) 

BASED  ON  DECISIONS: 9 ;10 
BASED  ON  MESSAGES :0 


Information  given  for  each  decision  Is  described  below. 


Explanation: 

]Part1c1pant  code  name 
]Data  list  option 


]Total  real  time  minutes  of 
simulation  time 

TNumber  of  messages  delivered 
,  Number  of  decisions  made 
JNumber  of  periods  completed 


Profile:  Explanation: 

R1/C0MPLEX  TEST  Identifying  Information  for 

computer  file 

YOUR  DECISION  TO  REDUCE  CREDIT 
TO  YUGOSLAVIA  BY  1  MILLION 

DOLLARS  9i-28>259  ]The  decision  (Ignore  coding 

at  end  of  text) 

TIME-32.5  ]Real  minute  of  simulation  time 

during  which  the  decision  was 
made;  minutes  cumulate  across 
periods 


Profile; 

PERIOD-2 


MESSAGES-! 2 


DECISION  NUMBER  17 


TIME-06/18  21 ;53;38 

( ;D1 33. 1 ) 

FUTURE  DECISIONS; (;D121 1.1) 


BASED  ON  DECISI0NS:9;10 


BASED  ON  MESSAGES: 0 


Next  fs  printed  the  total  number  of  decision  categories  and  a  list  of  all 
category  numbers  selected  during  the  simulation.  (Category  selection 
frequencies  are  not  provided.)  Number  of  categories  per  period  Is  pro¬ 
vided  later  In  the  printout. 


NUMBER  OF  CATEGORIES-19 
111 
112 
121 
122 

131 

132 

133 
211 
212 
213 
221 
222 
223 

231 

232 
311 

321 

322 
411 


Explanation: 

]Per1od  during  which  decision 
was  made 

]Tota1  number  of  messages 
received  preceding  the  decision 

]Dec1s1on  number  In  sequence 
from  start  of  simulation 

]S1mu1at1on  time  of  decision: 
month/da y  hour ;minute; second 

]Dec1sion  code  number 

]Code  number  of  future  decisions 
planned  at  the  time  of  this 
decision  (other  planned  decisions 
printed  out  In  separate  parentheses). 

]Decision  numbers  of  decisions 
on  which  this  decision  was 
based 

]Message  numbers  of  messages 
on  which  this  decision  was  based 
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Category  numbers  come  from  decision  alternative  code  numbers.  Each 
decision  alternative  has  Its  own  unique  decision  code.  Each  digit  In  the 
code  represents  a  position  on  successive  branches  of  a  tree  containing  all 
decision  alternatives.  Figure  3  shows  how  the  decision  code  numbers  are 
determined  for  eight  decisions  In  the  economic  area.  For  example,  the 
code  number  for  "Reduce  exports  of  high  technology  products  to  Russia"  Is 
(D)1 121 . 


A  decision  category  Is  any  decision  choice  sequence  through  the  first 
three  choice  options;  a  category  number  then  Is  the  first  three  digits  In 
the  decision  alternative  code.  Using  Figure  3  and  the  Information  below, 
see  how  the  following  two  decisions  are  In  the  same  category: 


Option  1 
Option  2 
Option  3 

Option  4 


Decision  1  (Code  1121)  Decision  2  (Code  1123) 


Economic 
Reduce  Exports 
Of  High  Technology 
Products 
To  Russia 


Economic 
Reduce  Exports 
Of  High  Technology 
Products 
To  Yugoslavia 


However,  the  decisions  below  are  In  different  categories.  These 
decisions  do  not  share  the  first  three  digits  of  their  codes. 


Decision  1  (Code  1121) 

Decision  2  (Code  1111) 

Option  1 

Economic 

Economic 

Option  2 

Reduce  Exports 

Reduce  Exports 

Option  3 

Of  High  Technology 
Products 

Of  Food 

Option  4 

To  Russia 

To  Russia 

Finally, 

the  printout  lists  the  participant's  score  on  each  of 

measures  for  each  simulation  period.  The  sample  below  Is  for  Period  1 
for  participant  "Complex  Test." 


PERIOD  1 

1- MEASURE-15  (f  OF  DECISIONS) 

2- MEASURE*5  33*  (#  OF 
RESPONDENT  DEC.) 


Explanation: 

JPerlod  number 

]Number  of  decisions 

]Number  of  respondent 
decisions,  and  per- 
cent  of  total  decisions 


3- MEASURE* 10  (#  OF  DEC.  CATEGORIES) 

4- MEASURE*! 3  86*  (#  OF  FWD 
INTEGRATIONS) 

5- MEASURE-133  886*  (MULTIPLEX1TY 

6- MEASURE-116  MINUTES  (WEIGHT) 

7- MEASURE-O  OX  (#  OF  BKD  INTEG) 

8- MEASURE«2  13X  (I  OF  UNINTEG. 

RES. DEC.) 

9- MEASURE*562  (QIS) 

10- MEASURE*2052  (WEIGHTED  QIS) 

11 - MEASURE-2. 9  (AVE. RESPONSE 
SPEED) 

12- MEASURE-4  (SERIAL  CONNECTIONS) 

13- MEASURE*!  (PUNNED  INTEGRATIONS) 

14- MEASURE-4  (GENERAL  UNINTEGRATED 
DEC.) 


]Number  of  decision  categories 

]Number  of  forward  Integrations 
(X  value  is  meaningless) 

]Mult1plex1ty  F  (X  value  is 
meaningless) 

]Weight  factor  In  real  minutes 
of  simulation  time 

]Number  of  backward  Integrations 
(X  value  is  meaningless) 

]Number  of  unintegrated 
respondent  decisions 

3QIS  (Quality  of  Integration 
strategies) 

Weighted  QIS 

]Average  response  speed  In 
real  time  seconds  of  simulation 
time 

]Number  of  serial  connections 

]Number  of  Integrations  planned 
but  not  executed 

jNumber  of  general  unintegrated 
decisions 


As  shown  In  Table  2,  the  data  used  In  classifying  profiles 
come  from  the  last  section  of  the  printout.  These  measures 
are  defined  below.  (Predicted  scores  and  a  brief  rationale 
for  the  predictions  is  presented  in  Section  4  of  this  chapter.) 
All  14  measures  are  discussed  In  greater  detail  with  sample 
calculations  in  Appendix  G. 


Number  of  decisions  (Measure  1)  is  the  total  number  of 
decisions  executed  within  a  simulation  period.  To  score 
a  decision,  a  participant  must: 


a  Enter  the  decision  code 

e  Execute  the  decision  (by  pressing 
RETURN  when  the  computer  asks  If 
the  decisions  should  be  executed) 
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Every  decision  Is  counted  even  If  the  same  decision  Is 
executed  more  than  once. 

Number  of  respondent  decisions  (Measure  2)  Is  the  total 
number  of  decisions  executed  within  a  simulation  period 
based  on  a  previous  message.  To  score  a  respondent 
decision,  a  participant  must: 

•  Execute  a  decision 

•  Report  that  the  decision  was 
based  on  a  previous  message 
or  messages 

If  one  decision  was  based  on  two  messages,  then  two 
respondent  decisions  are  scored  for  that  one  decision, 
and  so  forth.  Thus,  the  number  of  respondent  decisions 
may  exceed  the  total  number  of  decisions. 

Number  of  decision  categories  (Measure  3)  Is  the  total 
number  of  decision  categories  used  within  a  simulation 
period.  As  described  earlier  in  this  section,  a 
decision  category  Is  the  first  three  digits  of  a 
decision  code,  or  a  decision  choice  sequence  through, 
the  first  three  choice  options.  Decisions  coded  1211 
and  1213  are  In  the  same  category  (121),  but  decisions 
coded  1211  and  1221  are  In  different  categories.  The 
decision  category  of  each  executed  decision  Is  scored 
only  once  no  matter  how  often  It  Is  selected  within  a 
period. 

Number  of  forward  Integrations  (Measure  4)  Is  the  total 
number  of  forward  Integrations  originating  within  a 
period.  The  Integrations  may  be  completed  within  the 
period  of  origination  or  In  a  later  period.  To  score 
a  forward  Integration,  a  participant  must: 


t  Execute  a  decision 

•  Plan  a  future  decision  In 
another  decision  category 

•  Execute  the  planned  decision 
(or  any  decision  In  the  same 
category  as  the  planned  decision) 

•  Report  that  the  planned  decision 
was  based  on  the  previous  decision 


Multlplexlty  F  (Measure  5)  is  the  sum  of  the  count  of  each 
forward  integration  scored  within  a  period,  plus  all 
forward  Integrations  originating  and  ending  in  the  end¬ 
point  of  each  forward  Integration,  plus  all  forward 
Integrations  originating  (not  ending)  in  the  endpoint 
of  subsequent,  directly  connected  Integrations  leading 
to  the  end  of  the  simulation. 


The  sample  below  diagrams  seven  connected  forward 
Integrations  (indicated  by  the— ►  at  the  end  of 
the  diagonals).  For  example,  decision  C  was  planned 
at  decisions  A  and  B,  and  when  C  was  executed,  it 
was  reported  based  on  A  and  B. 
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We  will  use  this  diagram  to  explain  the  calculation 
of  Multi  pi exity  F  for  integration  BC. 

BC+AC+CD+CE+EF+FG  «  6 

HG  does  not  count  because  It  ends*  not  begins,  at 
the  endpoint  of  the  forward  integration  FG,  which  is 
not  the  integration  of  interest.  AC  counts  because, 
for  the  integration  of  interest,  DC,  all  integrations 
connected  to  its  endpoint  are  connected.  If  all 
seven  integrations  were  scored  in  one  period,  the 
total  for  the  period  would  be  the  sum  of  the  values 
for  each  integration. 

Weight  or  integration  time  weight  (Measure  6)  Is  the 
sum  of  the  time  elapsed  from  Initial  to  endpoint 
decision  for  each  forward  Integration  scored  in  a 
period.  Time  in  this  measure  is  real  minutes  of 
simulation  time.  For  example,  If  time  from  original 
decision  A  to  planned  and  executed  endpoint  decision 
C  is  three  minutes,  and  from  decision  B  to  planned 
decision  D  Is  five  minutes,  the  weight  is  eight 
minutes  (even  If  AC  and  BD  overlap  In  time). 

Backward  Integrations  (see  Measure  7)  are  not 
counted  In  this  measure. 

Number  of  backward  integrations  (Measure  7)  is  the 
total  number  of  backward  Integrations  originating 
in  a  period.  The  backward  integration  may  or  may  not 
end  In  the  same  period.  To  score  a  backward  Integra¬ 
tion,  the  participant  must: 

•  Enter  a  decision  A  (endpoint  decision) 

•  Not  enter  plans  to  execute  decision  B 

e  Execute  decision  B  (the  origin  decision) 
in  a  different  category  from  decision  A 


•  Report  that  decision  6  was  based 
in  part  on  decision  A 

Note  that  backward  integrations ,  unlike  forward 
integrations,  originate  at  a  time  later  than  their 
endpoints.  Both  forward  and  backward  integrations, 
however,  are  credited  to  the  period  during  which 
they  originated. 

Unintegrated  respondent  decisions  (Measure  8)  is  the 
total  number  of  unintegrated  respondent  decisions 
within  a  period.  An  unintegrated  respondent  decision 
occurs  In  response  to  a  message,  but  may  not  originate 
a  forward  integration.  An  unintegrated  respondent 
decision  may,  however,  be  part  of  a  backward  integra¬ 
tion,  or  the  endpoint  of  a  forward  integration,  and 
it  may  lead  to  another  decision  in  the  same  category. 
Unintegrated  respondent  decisions  are  a  special  case 
of  respondent  decisions  because  general  respondent 
decisions  may  be  any  part  of  an  Integration.  To 
score  an  unintegrated  respondent  decision,  a  parti¬ 
cipant  must: 

•  Execute  decision  A  (A  may  be 
planned  or  not  planned) 

e  Report  that  decision  A  was 
based  on  a  previous  message 

AND  EITHER 

t  at  the  time  decision  A  Is 
executed,  not  report  a 
decision  plan  in  a  different 
category 

OR 

t  report  a  decision  plan  In  a 
different  category,  execute 
the  plan,  but  not  report  It 
based  on  decision  A 
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QIS  or  quality  of  integrated  strategies  (Measure  9) 
is  the  sum  of,  for  each  forward  Integration  scored 
in  a  period,  the  time  weight  for  that  integration 
multiplied  by  the  sum  of  the  number  of  forward 
Integrations  originating  and  ending  at  the  origin 
and  endpoint  of  the  forward  Integration  plus  one 
for  that  forward  Integration.  Refer  to  the  sample 
below.  If  vector  AB  is  a  forward  integration, 
and  forward  Integration  vectors  CA  and  DA  end  at 
decision  A  in  AB,  and  AE  originates  at  A  In  AB, 
and  forward  integration  vectors  BF  and  BG  originate 
at  B  in  AB,  and  HB  ends  at  B  in  AB,  and  the  time 
elapsed  from  A  to  B  is  four  minutes,  the  QIS  score 
is  four  (the  time  weight)  multiplied  by  the  sum 
one  for  AB  plus  three  for  CA,  DA,  and  AE,  plus 
three  for  BF,  BG,  and  HB,  or  4(7)  or  28. 

Category 
111 
121 
123 
131 
211 
222 
232 
311 

Weighted  QIS  (Measure  10)  is  the  sum  of  each  forward 
integration  scored  in  a  period,  plus  all  forward 
Integrations  originating  and  ending  at  both  ends  of 
the  forward  Integration,  plus  all  forward  integra¬ 
tions  originating  (not  ending)  in  the  endpoint  of 
subsequent,  directly  connected  integrations  until 
the  end  of  the  simulation,  plus  all  forward  inte¬ 
grations  ending  (not  originating)  in  the  origin 
of  previous  directly  connected  integrations  until 
the  beginning  of  the  simulation,  multiplied  by 
the  time  weight.  Refer  to  the  diagram  below. 


Time 


Category 

m 

121 

122 

123 

211 

221 

222 

311 


Time 


If  vector  AB  is  a  forward  integration,  and  forward 
integration  CA  connects  to  A  in  AB,  and  DC  connects 
to  C  In  CA,  and  CE  connects  to  C  In  CA,  and  BF  and 
HB  connect  to  B  in  BA  and  GF  connects  to  F  In  BF, 
and  time  elapsed  from  A  to  B  Is  five  minutes,  the 
weighted  QIS  score  Is  five  multiplied  by  the  sum 
of  one  for  AB  plus  one  each  for  CA  and  DC  (not  CE 
which  originates  not  ends  In  DC  and  CA),  plus  one 
each  for  HB  and  BF  (not  GF  which  ends  not  originates 
in  BF),  or  5(5)  «  25.  Weighted  QIS  Is  not  QIS 
multiplied  by  the  integration  time  weight  as 
the  name  might  Imply.  It  Is  QIS  (which  already 
Includes  time  weight)  weighted  with  integrations 
distal ly  connected  to  a  target  integration. 


[The  QIS  score  for  the  above  sample  would  be 
five  times  (1  for  AB  +  1  for  CA  +  1  for  BF  + 

1  for  HB)  «  5(4)  *  20.  The  Multiplexlty  F 
for  the  sample  would  be  one  for  AB  plus  one 
for  HB  plus  one  for  BF  or  three.  Multiplexlty 
F  Is  essentially  the  forward  half  of  WQIS  minus 
the  time  weight.] 


Average  response  speed  (Measure  11)  is  the  average 
time  (in  real  minutes  of  simulation  time)  elapsed 


between  receipt  of  a  message  and  subsequent 
execution  of  a  respondent  decision.  (Recall 
that  a  respondent  decision  is  one  the  parti¬ 
cipant  reports  was  based  on  a  previous 
message.  See  Measure  2.)  The  calculation 
is  based  on  every  respondent  decision  within 
a  period. 

Number  of  serial  connections  (Measure  12)  is  the 
number  of  serial  connections  scored  in  one  period. 
A  serial  connection  would  be  Identical  to  an 
integration  (see  Measures  4  and  7)  except  that 
decisions  connected  serially  fall  in  the  same 
decision  category,  whereas  integrated  decisions 
fall  in  different  decision  categories. 

A  serial  connection  may  be  either  forward  or 
backward;  this  measure  includes  both  types. 

To  score  a  serial  connection,  the  participant  must; 

EITHER 

•  Execute  decision  A 

•  Plan  decision  B  in  the 
same  category 

•  Report  that  decision  B  was 
based  on  decision  A 

OR 

t  Execute  decision  A 

•  Not  plan  decision  B 

•  Execute  decision  B  In  the 
same  category  as  decision  A 

•  Report  that  decision  B  was 
based  on  decision  A 


Planned  integrations  (Measure  13)  Is  the  number 
of  forward  Integrations  planned  but  not  executed 
any  time  before  the  end  of  the  simulation.  If 
the  Integration  Is  accomplished  at  any  time, 
even  In  a  later  period  than  the  origin  decision. 

It  Is  considered  an  executed  Integration.  Planned 
but  not  executed  Integrations  are  credited  to  the 
period  In  which  the  origin  decision  was  entered. 

The  planned  decision  must  be  In  a  different 
decision  category  from  the  origin  decision  category. 

To  score  a  planned  but  not  executed  integration, 
the  participant  must: 

•  Execute  decision  A 

•  Plan  decision  B  In  another 
category 

AND  EITHER 

•  Not  execute  decision  B 

OR 

•  Execute  decision  B  (or  any 
decision  In  B  category)  but 
not  report  that  decision  B 
was  based  on  decision  A 

General  unintegrated  decisions  (Measure  14)  Is  the 
number  of  general  unintegrated  decisions  within  a 
period.  A  general  unintegrated  decision  Is  a  decision 
which  Is  not  part  of  a  forward  or  backward  integration. 
It  may  be  part  of  a  serial  connection,  or  It  may  be 
respondent,  or  planned  but  not  executed,  or  planned, 
executed,  but  not  reported  based  on  the  previous 
decision,  or  Isolated  completely.  Unintegrated 
respondent  decisions  and  planned  but  not  executed 
Integrations  are  subsets  (may  be  overlapping)  of 
general  unintegrated  decisions. 


Comparing  Profiles 


Nine  measures  have  been  selected  as  the  basis  for 
comparing  profiles.  These  measures  were  selected 
because  Interactive  complexity  theory  (which  is 
the  basis  for  the  simulation)  predicts  that  the 
different  classifications  of  decision  makers, 
described  earlier,  will  be  characterized  by 
different  scores  on  these  measures.  As  shown  in 
Table  2,  these  measures  come  from  data  on  the 
printout.  Other  measures  to  be  used  In  comparing 
profiles  may  be  added  later  as  testing  on  the 
simulation  continues,  but  at  this  time,  nine 
measures  have  been  chosen.  The  measures  are 
described  below  and  general  predictions  for  the 
different  decision-making  classifications  are 
given.  The  measures  are  discussed  in  the  order 
In  which  they  appear  on  the  sample  classification 
graphs. 

Number  of  general  unintegrated  decisions  (Measure 
14).  These  decisions  are  not  part  of  forward 
or  backward  Integrations.  General  unintegrated 
decisions  reflect  a  lack  of  overall  planning. 

They  often  represent  trial  and  error  actions. 
Multidimensional  persons,  especially  Integrators, 
would  not  score  many  unintegrated  decisions  in  a 
complex,  demanding  situation  like  the  Yugoslav 
D1 lemma  because  most  of  their  decisions  would  be 
Integrated.  An  excessive  number  of  unintegrated 
decisions  may  be  expected  on  the  Yugoslav  Dilemma 
from  unidimensional  persons  who  generally  do  not 
plan  and  execute  strategy. 

Number  of  respondent  decisions  (Measure  2). 
Respondent  decisions  are  based  on  messages; 
they  may  or  may  not  be  part  of  integrations. 
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Thus,  some  respondent  decision-making  is 
evident  In  the  behavior  of  all  complexity 
groups.  However,  respondent,  as  opposed  to 
Integrated,  decisions  are  particularly 
prevalent  in  decision  sequences  generated  by 
uni dimensional  persons.  Persons  who  can 
neither  differentiate  nor  integrate  tend  to 
depend  on  the  immediate  environment  for  cues 
upon  which  they  can  base  their  actions. 

Especially  in  situations  where  the  immediate 
environment  Is  complex,  respondent  decisions 
by  unidimensional  persons  may  be  substantially 
Increased  in  number  and  often  reach  or  exceed 
50%  of  their  total  decisions.  This  is  because 
the  person  may  react  separately  to  each  bit  of 
information.  Strategic  reactions,  of  course, 
would  be  near  zero. 

Proportion  of  unintegrated  respondent  to  respondent 
decisions  (Measures  8  and  2).  The  proportion  of 
unintegrated  respondent  to  total  number  of  respon¬ 
dent  decisions  reflects  Integrative  strategy.  As 
the  proportion  nears  1.0,  less  integrative  strategy 
Is  implied.  Thus,  scores  near  1.0  would  be  expected 
from  uni dimensional  participants,  and  scores  closer 
to  0  expected  from  multidimensional  participants, 
with  integrators  scoring  closer  to  0  than  differentiators. 

Number  of  backward  integrations  (Measure  7).  Backward 
integrations,  planned  only  after  decisions  are  executed, 
reflect  less  strategic  planning  than  forward  Integra¬ 
tions,  but  nevertheless  reflect  some  strategy.  Thus, 
they  occur  with  greater  frequency  for  multidimensional 
than  for  uni dimensional  participants.  A  few  backward 
Integrations  may  be  generated  by  unidimensional  persons, 
but  larger  score  values  should  be  seen  In  the  profiles 
for  differentiators  and  the  two  groups  of  Integrators. 


[Differences  in  the  use  of  backward  integrations 
by  differentiators,  low-level  integrators,  and 
high-level  integrators  may  become  evident  (with 
future  participants)  by  calculating  the  propor¬ 
tion  of  backward  integrations  to  all  integrations. 
As  the  resulting  value  moves  closer  to  1.0,  the 
cognitive  complexity  of  the  decision-maker  would 
likely  be  lower.] 

Number  of  forward  integrations  adjusted  by  number 
of  planned  but  not  executed  integrations  (Measures 
4  and  13).  Number  of  forward  integrations  is  the 
basic  and  most  frequently  employed  measure  of 
decision  integration.  Very  low  scores  would  be 
predicted  for  unidimensional  persons,  low  scores 
for  differentiators  and  moderate  to  high  scores  for 
integrators. 


Unless  the  measure  Is  adjusted  by  number  of  planned 
but  not  executed  integrations,  however,  the  measure 
Is  too  conservative  and  loses  sensitivity.  In  order 
to  score  a  forward  Integration,  a  participant  must 
plan  a  decision  then  execute  it.  If  the  plan  Is  not 
executed  later,  we  do  not  know  if  it  was  due  to  lack 
of  strategy  or  lack  of  time  before  the  simulation 
ended  ("simulation  end  effect").  Therefore,  we 
should  credit  all  or  some  planned  but  not  executed 
integrations  as  forward  Integrations.  To  increase 
the  likelihood  that  this  adjustment  is  correcting  for 
end  effects  and  not  lack  of  strategy,  the  credit  should 
Increase  across  periods.  For  example,  we  assume  that 
Integrators  execute  all  plans  made  1r  period  1,  but 
people  with  lack  of  strategy  will  not.  Thus,  no 
adjustment  should  be  made  for  period  1.  This  adjust¬ 
ment  should  Increase  the  likelihood  that  we  identify 
Integrators. 


For  the  preliminary  comparison  sample,  number  of  total 
forward  integrations  was  calculated  by  adding  together: 

Period  1:  Number  of  forward  integrations  plus 
OX  planned  but  not  executed  integra¬ 
tions  (unadjusted) 

Period  2:  Number  of  forward  integrations  plus 
SOX  planned  but  not  executed  integra¬ 
tions 

Period  3:  Number  of  forward  integrations  plus 
100X  planned  but  not  executed  Inte¬ 
grations. 

Multiplexity  F  (Measure  5).  Multiplexity  F  means  multiple 
complex  strategies  In  a  forward  direction.  As  any  one 
course  of  action  is  approached  from  Increasing  numbers  of 
decision  points,  and  as  that  course  links  directly  to 
other  steps  In  a  plan,  multiplexity  F  scores  increase. 

This  type  of  planning  is  characteristic  of  multidimensional , 
not  uni di mens 1 onal ,  planners. 

Within  multidimensional  planners,  differentiators  will 
score  only  low  or  moderately  high  on  this  measure.  Low- 
level  Integrators  score  moderately  high,  and  high-level 
Integrators  attain  high  scores. 

The  basic  calculation  In  a  multiplexity  F  score  Is  number 
of  forward  Integrations.  Number  of  forward  integrations 
has  not  been  adjusted  for  planned  but  not  executed  Inte¬ 
grations,  as  mentioned  above.  Such  an  adjustment  may  be 
needed  In  the  future  to  Increase  Its  sensitivity  to 
different  types  of  Integrators,  but  was  unnecessary  with 
the  present  comparison  sample. 

Weight  (Measure  6).  This  measure  indicates  the  length 
of  time  across  which  persons  Integrate.  The  lowest  weight 
scores  would  be  scored  by  unidimensional  planners  who  do 


not  Integrate.  Differentiators  may  produce  weight 
scores  slightly  higher  than  those  for  unidimensional 
persons,  but  differentiators'  scores  would  remain 
near  the  lower  end  of  the  distribution  for  this 
measure.  Low-level  Integrators  should  generate 
moderate  weight  scores  and  considerably  greater 
weight  scores  should  be  generated  by  high-level 
Integrators. 

The  weight  measure  may  suffer  from  the  "simulation 
end  effect"  discussed  under  "number  of  forward 
Integrations."  It  is  difficult  to  adjust  the  weight 
measure,  however,  because  we  would  have  to  guess  at 
what  time  a  planned  integration  would  occur.  Should 
a  future  adjustment  become  desirable,  we  might  use 
the  obtained  mean  weight  per  Integration  as  the  constant. 

Quality  of  integrated  strategies  (QIS)  (Measure  9).  For 
each  forward  Integration,  QIS  adds  the  number  of  forward 
integrations  directly  connected  to  the  beginning  and  end¬ 
points  of  the  forward  integration  and  multiplies  this  sum 
by  the  time  weight.  Thus,  QIS  Increases  as  individual 
Integrations  become  woven  into  other  Integrations.  QIS 
Is  low  for  differentiators,  even  lower  for  uni  dimensional 
persons.  QIS  Is  slightly  higher  for  low-level  Integrators 
than  for  differentiators  and  may  reach  very  high  levels 
for  high-level  Integrators.  (QIS  has  not  been  adjusted 
for  simulation  end  effects.) 

Weighted  QIS  (Measure  10).  For  each  forward  integration, 
weighted  QIS  (like  QIS)  adds  up  all  forward  integrations 
connected  to  the  beginning  and  endpoints  of  the  forward 
Integration,  but  unlike  QIS,  weighted  QIS  also  Includes 
all  forward  Integrations  linked  to  those  integrations 
tracing  them  all  the  way  to  the  beginning  and  end  of  the 
simulation.  Thus,  this  measure  increases  with  high  levels 


of  strategic  planning  and  lengthy  sequences  of  decisions 
toward  more  distant  goals.  Lengthy  sessions  are  required 
In  order  to  generate  high  scores  on  this  measure.  The 
relatively  short  (relative  to  other  decision-making 
simulations)  Yugoslav  Dilemma  restricts  scores  for 
weighted  QIS.  Nonetheless,  we  can  predict  that  the 
highest  scores  on  this  measure  will  be  generated  by  high- 
level  Integrators.  Scores  for  low-level  integrators 
should  remain  moderately  low,  and  scores  achieved  by 
all  other  groups  should  remain  near  zero. 

Four  of  the  14  measures  are  not  Included  in  the  profile 
comparison  process: 

•  Number  of  decisions  (Measure  1) 

•  Number  of  decision  categories  (Measure  3) 

•  Average  response  speed  (Measure  11) 

•  Serial  connections  (Measure  12) 

Score  predictions  for  these  measures  cannot  be  made  on  the 
basis  of  complexity  theory  as  It  stands  today.  Presently, 
it  is  thought  that  these  measures  are  influenced  by  specific 
content  characteristics  of  a  simulation,  and  not  by  structural 
aspects  of  a  participant's  decision-making. 

In  order  to  compare  a  participant's  style  to  the 
preliminary  comparison  sample,  the  researcher 
must  follow  the  steps  listed  below: 

o  Calculate  the  proportion  of  unintegrated 
respondent  to  total  respondent  decisions 
for  each  period. 

t  Adjust  forward  Integrations  for  each 
period  using  the  adjustment  described 
above. 
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•  For  each  of  the  nine  measures  used, 
calculate  a  per- period  average  by 
totalling  the  scores  and  dividing 
by  the  number  of  periods. 

•  Plot  the  nine  averages  on  each  of  the 
three  ( uni di mens 1 onal ,  multidimen¬ 
sional  different!" ative,  multidimen¬ 
sional  Integrative)  tentative  compari¬ 
son  graphs  (Figures  4,  5,  and  6). 

•  Determine  best  fit. 

Figures  4,  5,  and  6  are  the  preliminary  comparison  graphs 
for  unidimensional,  multidimensional  differentiative,  and 
multidimensional  Integrative  style,  respectively.  These 
graphs  were  based  on  a  very  small  sample  of  participants, 
have  NOT  been  validated,  and,  thus,  may  be  considered  as 
tentative.  The  interested  reader  may  refer  to  Swefzey, 
Streufert,  Criswell,  Unger,  and  van  Rijn  (1984)  for  more 
information  on  the  derivation  of  these  comparison  figures. 

Scores  should  fit  within  the  window  on  one  of  the  comparison 
graphs.  If  several  scores  fall  above  or  below  a  window, 
this  would  suggest  that  the  person's  performance  reflects  a 
different  decision-making  style  than  is  represented  on  that 
comparison  graph.  The  best  fit  within  the  window  area  of  a 
graph  Indicates  the  group  to  which  that  person  would  be 
tentatively  assigned. 

Let  us  use  the  sample  for  participant  "Complex  Test"  in 
Appendix  F  In  an  example  of  how  to  use  the  comparison  graphs. 
Table  3  shows  how  the  per-perlod  means  for  the  nine  measures 
are  calculated. 

Next,  the  means  are  plotted.  Figures  7,  8,  and  9  show  how 
these  values  fit  against  each  of  the  three  graphs.  The 
values  fit  best  with  multidimensional  Integrators. 
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Figure  5.  Performance  score  ranges  in  the  Yugoslav  Dilemma  simulation  expected  for  multidimensional  differentiators 


Figure  6.  Performance  score  ranges  in  the  Yugoslav  Dilemna  simulation  expected  for  multidimensional  integrators 


TABLE  3 

CALCULATION  OF  SAMPLE  PARTICIPANT'S  SCORES  FOR  PROFILE  COMPARISON 
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Figure  7.  Scores  for  sample  participant  "Complex  Test"  compared  to  unidimensional  range. 


participant  "Complex  Test"  compared  to  multidimensional  differentiator  range 


Figure  9.  Scores  for  sample  participant  "Complex  Test"  compared  to  multidimensional  integrator  range 


5.  Expert  Strategies 


As  emphasized  earlier  In  this  manual,  complexity  theory 
and  the  Yugoslav  Dilemma  are  concerned  with  the  structure 
and  process  of  decision  making,  not  with  the  quality  of 
the  decision.  Thus,  can  we  say  that  a  person  who  demon¬ 
strates  more  strategic  forward  integrations  between 
decisions  Is  a  better  decision  maker  than  one  who  fails 
to  generate  these  connections?  For  any  given  task, 
however,  whether  or  not  a  particular  decision-making  style 
is  optimal  depends  on  the  task,  the  environment,  and  the 
limitations  of  content  that  are  acceptable  in  that  environ 
ment. 

To  illustrate,  consider  how  two  different  tasks  and 
environments  call  for  two  different  decision-making 
structures.  First  consider  a  task  environment  which 
Is  simple,  where  only  two  choices  are  available,  neither 
has  important  long-term  implications,  one  of  the  two 
choices  has  immediate  desirable  outcomes,  and  the  other 
has  immediate  undesirable  outcomes.  An  example  might 
be  whether  to  put  gas  In  the  car  when  it  Is  nearly  empty 
or  drive  the  car  until  It  runs  out  of  gas.  In  cases  of 
that  kind,  there  Is  no  need  to  use  a  complex  decision¬ 
making  strategy.  A  good  versus  a  bad  decision  Is  easy 
to  judge  In  the  very  simple  case. 

Second,  consider  a  case  where  task  and  environment  are 
complex,  where  decisions  must  be  made  under  conditions 
of  uncertainty,  where  the  long-range,  sequential  effects 
of  current  decisions  need  to  be  considered  and  where  the 
opponent  Is  likely  to  employ  specific  strategy.  An 
example  of  complex  task  and  environment  might  be  the 
Yugoslav  Dilemma,  or  Its  real  world  counterpart.  Clearly, 
quick,  simple  decisions  would  be  maladaptive.  Without 
refering  at  all  to  the  content  of  the  crisis,  we  may  say 
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that  careful  consideration  of  Information  from  many 
sources,  planned  information  collection,  and  flexible 
responding  as  the  situation  changes  are  desirable 
characteristics  of  executive-level  decision  making. 
Perhaps  the  best  executive-level  decision  maker  is 
one  who  has  a  variety  of  simple  and  complex  strategies 
available  in  his  or  her  repertoire  to  apply  as  the 
situation  requires.  Optimal  strategies  are  situation 
dependent. 
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APPENDIX  A 

DECISION  ALTERNATIVES  FOR  STORM  SCENARIO 
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STORM  SCENARIO  DECISION  ALTERNATIVES 


Evacuation  Action  You  Can  Take 

1111  Alert  the  administrators  of  Jackson  High  School 

1112  of  Kennedy  High  School 

1121  Alert  the  teachers  of  Jackson  High  School 

1122  of  Kennedy  High  School 

12111  Move  the  administrators  of  Jackson  High  School  to  Marsh  Park 

12112  to  Tyson's  Corner 

12113  to  quadrant 

12121  Move  the  administrators  of  Kennedy  High  School  to  Marsh  Park 

12122  to  Tyson's  Corner 

12123  to  quadrant 

12211  Move  the  students  of  Jackson  High  School  to  Marsh  Park 

12212  to  Tyson's  Corner 

12213  to  quadrant 

12221  Move  the  students  of  Kennedy  High  School  to  Marsh  Park 

12222  to  Tyson’s  Corner 

12223  to  quadrant 

12311  Move  the  teachers  of  Jackson  High  School  to  Marsh  Park 

12312  to  Tyson's  Comer 

12313  to  quadrant 

12321  Move  the  teachers  of  Kennedy  High  School  to  Marsh  Park 

12322  to  Tyson's  Corner 

12323  to  quadrant 


Information  Search  You  Can  Request 


2111  Determine  threat  to  administrators  of  Jackson  High  School 

2112  of  Kennedy  High  School 

2121  Determine  threat  to  teachers  of  Jackson  High  School 

2122  of  Kennedy  High  School 

2131  Determine  threat  to  students  of  Jackson  High  School 

2132  of  Kennedy  High  School 

2211  Assess  damage  to  roads  In  the  city 

2212  in  the  suburbs 

2221  Assess  damage  to  communications  facilities  in  the  city 

2222  in  the  suburbs 
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APPENDIX  B 

DECISION  ALTERNATIVES  FOR  YUGOSLAV  DILEMMA 


ECONOMIC  ACTION  YOU  CAN  TAKE 


Btduct  exports  of  focd 

1111  to  Russia 

1112  to  Bulgaria 

1113  to  Yugoslavia 

1114  to  Romania 

Reduce  exports  of  high  technology  products 

1121  to  Russia 

1122  to  Bulgaria 

1123  to  Yugoslavia 

1124  to  Romania 

Reduce  Imports  of  raw  materials 

1211  to  Russia 

1212  to  Bulgaria 

1213  to  Yugoslavia 

1214  to  Romania 

Reduce  imports  of  manufactured  goods 

1221  to  Russia 

1222  to  Bulgaria 

1223  to  Yugoslavia 

1224  to  Romania 

Reduce  credit  bv  1  million  dollars 

1311  to  Russia 

1312  to  Bulgaria 

1313  to  Yugoslavia 

1314  to  Romania 

Reduce,  credit  by  5  minion  dollars 

1321  to  Russia 

1322  to  Bulgaria 

1323  to  Yugoslavia 

1324  to  Romania 

Reduce  credit  bv  10  million  dollars 
1331 to  Russia 

1332  to  Bulgaria 

1333  to  Yugoslavia 

1334  to  Romania 

Reduce  credit  bv  50  million  dollars 

1341  to  Russia 

1342  to  Bulgaria 

1343  to  Yugoslavia 

1344  to  Romania 

Increase  exports  of  food 

1411  to  Russia 

1412  to  Bulgaria 

1413  to  Yugoslavia 

1414  to  Romania 

Increase  exports  of  high  technology  products 

1421  to  Russia 

1422  to  Bulgaria 

1423  to  Yugoslavia 

1424  to  Romania 

Increase  limnrts  nf  raw  materials 

1511  to  Russia 

1512  to  Bulgaria 

1513  to  Yugoslavia 

1514  to  Romania 

Increase  imports  of  manufactured  goods 

1521  to  Russia 

1522  to  Bulgaria 

1523  to  Yugoslavia 

1524  to  Romania 


Increase  credit  bv  1  million  dollars 
Un  to  Russia 

1612  to  Bulgaria 

1613  to  Yugoslavia 

1614  to  Romania 

Increase  credit  bv  5  minion  dollars 

1621  to  Russia 

1622  to  Bulgaria 

1623  to  Yugoslavia 

1624  to  Romania 

Increase  credit  bv.  10  million,  dollars 

1631  to  Russia 

1632  to  Bulgaria 

1633  to  Yugoslavia 

1634  to  Romania 

Increase  credit  by  50  million  dollars 
1641 to  Russia 

1642  to  Bulgaria 

1643  to  Yugoslavia 

1644  to  Romania 


POLITICAL  ACTION  YOU.  CAN  TARE 


Send  messages  concerning  the  potential  Imposition  of  economic .sanctions 

21111  to  the  Russian  Ambassador 

21112  Foreign  Minister 

21113  President 

21121  to  the  Bulgarian  Ambassador 

21122  Foreign  Minister 

21123  President 

21131  to  the  Yugoslavian  Ambassador 

21132  Foreign  Minister 

21133  President 

21141  to  the  Romanian  Ambassador 

21142  Foreign  Minister 

21143  President 

Send  messages  concerning  the, potential  resumption  of  normal  trade 

21211  to  the  Russian  Ambassador 

21212  Foreign  Minister 

21213  President 

21221  to  the  Bulgarian  Ambassador 

21222  Foreign  Minister 

21223  President 

21231  to  the  Yugoslavian  Ambassador 

21232  Foreign  Minister 

21233  President 

21241  to  the  Romanian  Ambassador 

21242  Foreign  Minister 

21243  President 

Send  messaaes  concerning  the  potential  Involvement  of  U.S.  forces  In  Yugoslavia 

21311  to  the  Russian  Ambassador 

21312  Foreign  Minister 

21313  President 

21321  to  the  Bulgarian  Ambassador 

21322  Foreign  Minister 

21323  President 

21331  to  the  Yugoslavian  Ambassador 

21332  Foreign  Minister 

21333  President 

21341  to  the  Romanian  Ambassador 

21342  Foreign  Minister 

21343  President 


e 


B-2 


V.V.' 


v’. 


messages  concerning  U.S.  Interests  In  a  non-aligned  Yugoslavia 


21411  to  the  RusslanAmbassador 

21412  Foreign  Minister 

21413  President 

21421  to  the  Bulgarian  Ambassador 

21422  Foreign  Minister 

21423  President 

21431  to  the  Yugoslavian  Ambassador 

21432  Foreign  Minister 

21433  President 

21441  to  the  Romanian  Ambassador 

21442  Foreign  Minister 

21443  President 

Send  diplomats  to  discuss  potential  Imposition  of  economic  sanctions 
to  the  Russian  Ambassador  ™" 

22112  Foreign  Minister 

22113  President 

22121  to  the  Bulgarian  Ambassador 

22122  Foreign  Minister 

22123  President 

22131  to  the  Yugoslavian  Ambassador 

22132  Foreign  Minister 

22133  President 

22141  to  the  Romanian  Ambassador 

22142  Foreign  Minister 

22143  President 
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22211  with  the 

22212 
22213 

22221  with  the 

22222 
22223 

22231  with  the 

22232 

22233 

22241  with  the 

22242 

22243 


tentlal  res 


Russian  Ambassador 

Foreign  Minister 
President 

Bulgarian  Ambassador 

Foreign  Minister 
President 

Yugoslavian  Anbassador 

Foreign  Minister" 
President 

Romanian  Ambassador 

Foreign  Minister 
President 


tlon  of  normal  trade 


Send  diplomats  to  discuss  potential  Involvement  of  U.S.  forces  In  Yugoslavia 


with  the  Russian  Ambassador 

22312  Foreign  Minister 

22313  President 

22321  with  the  Bulgarian  Ambassador 

22322  Foreign  Minister 

22323  President 

22331  with  the  Yugoslavian  Ambassador 

22332  Foreign  Minister 

22333  President 

22341  with  the  Romanian  Ambassador 

22342  Foreign  Minister 

22343  President 


Iscuss  U.S.  Interests  In  a  non-aligned  Yugoslavia 


22411  with  the  Russian  Ambassador 

22412  Foreign  Minister 

22413  President 

22421  with  the  Bulgarian  Ambassador 

22422  Foreign  Minister 

22423  President 

22431  with  the  Yugoslavian  Ambassador 

22432  Foreign  Minister 

22433  President 

22441  with  the  Romanian  Ambassador 

22442  Foreign  Minister 

22443  Presl dent 


Arrange  a  conference  with  cabinet  members 

2311  to  Assess  previous  political  actions 

2312  military  actions 

2313  economic  actions 

2314  covert  operations 

2315  public  opinion  actions 


!31  to  airfields  in  Britain 


32232  In  W.  Germany 

32233  In  Greece 

32234  In  quadrant 


32312  In  W.  Germany 

32313  In  Italy 

32314  In  Greece 

32315  In  quadrant 

Move  U.S.  Army  Europe  Division  B  (Infantry) 


32321  to  bases  inBritain 

32322  In  W.  Germany 

32323  In  Italy 

32324  In  Greece 

32325  In  quadrant 

Move  U.S.  Army  Europe  Division  C  (mechanised) 


32331  to  bases  In  Britain 

32332  In  W.  Germany 

32333  In  Italy 

32334  In  Greece 

32335  In  quadrant 


32341  to  bases  In  Britain 

32342  In  W.  Germany 

32343  In  Italy 

32344  In  Greece 

32345  In  quadrant 

Move  U.S.  Rapid  Deployment  Force  Division  A  (mechanized 


3Z411  to  bases  in  Britain 

32412  In  W.  Germany 

32413  In  Italy 

32414  In  Greece 

32415  In  quadrant 


32421  to  bases  In  Britain 


In  W.  Germany 
In  Italy 
In  Greece 
In  quadrant 
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32431  to  bases  In  Britain 

32432  in  H.  Germany 

32433  In  Italy 

32434  In  Greece 

32435  In  quadrant 

Move  U.S.  Rapid  Deployment  Force  Special  Forces  Units 

32441  to  bases  In  Britain  — 

32442  In  W.  Germany 

32443  In  Italy 

32444  In  Greece 

32445  In  quadrant 

Conduct  reconnaissance  missions 
3311 In  Russia  with  satellites 

3312  _  _  .  with  SR- 71  aircraft 

3313  with  foot  patrols 

3321  In  Bulgaria  with  satellites 

3322  with  SR-71  aircraft 

3123  with  foot  patrols 

3331  In  Yugoslavia  with  satellites 

3332  with  SR-71  aircraft 

3333  with  foot  patrols 

3341  in  Romania  with  satellites 

3342  with  SR-71  aircraft 

3343  with  foot  patrols 
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COVERT  OPERATIONS  ACTIONS  YOU  CAN  TAKE 


4111  about  planned  U.S. 

4112 

4113 

4114 

4121  about  planned  U.S. 

4122 

4123 

4124 

4131  about  planned  U.S. 

4132 

4133 

4134 

4141  about  planned  U.S. 

4142 

4143 

4144 


military  actions  In  Russia 
In  Bulgaria 
In  Yugoslavia 
In  Romania 
political  actions  In  Russia 
In  Bulgaria 
In  Yugoslavia 
In  Romania 

economic  actions  In  Russia 
In  Bulgaria 
In  Yugoslavia 
In  Romania 
covert  operations  In  Russia 
In  Bulgaria 
In  Yugoslavia 
In  Romania 


additional  agents 

to  penetrate  military  organizations  In  Russia 

In  Bulgaria 
In  Yugoslavia 
In  Romania 

to  penetrate  political  organizations  In  Russia 

In  Bulgaria 
In  Yugoslavia 
In  Romania 

to  penetrate  Intelligence  organizations  In  Russia 

In  Bulgaria 
In  Yugoslavia 
In  Romania 


Sabotage 

4311  power  plants  In  Russia 

4312  In  Bulgaria 

4313  In  Yugoslavia 

4314  In  Romania 

4321  rail  lines  In  Russia 

4322  In  Bulgaria 

4323  In  Yugoslavia 

4324  In  Romania 

4331  comnunlcatlon  facilities  In  Russia 

4332  In  Bulgaria 

4333 

4334 

4341  air  fields  In  Russia 

4342  In  Bulgaria 

4343  In  Yugoslav 

4344  In  Romania' 

4351  fuel  dumps  In  Russia 

4352  In  Bulgaria 

4353  In  Yugoslav 

4354  In  Romania 

4361  navy  yards  In  Russia 

4362  In  Bulgaria 

4363  In  Yugoslav 

4364  In  Romania 


In  Yugoslavia 
In  Romania 


In  Bulgaria 
In  Yugoslavia 
In  Romania' 
fuel  dumps  In  Russia 
In  Bulgaria 
In  Yugoslavia 
In  Romania 
navy  yards  In  Russia 
In  Bulgaria 
In  Yugoslavia 
In  Romania 


4371  bridges  In  Russia 

4372  In  Bulgaria 

4373  In  Yugoslavia 

4371  In  Romania 

4381  Industrial  plants  In  Russia 

438?  In  Bulgaria 

4383  In  Yugoslavia 

4384  in  Romania 

4391  army  bases  In  Russia 

4392  In  Bulgaria 

4393  In  Yugoslavia 

4394  In  Romania 
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4411 

4412 

4413 

4414 

4421 

4422 

4423 

4424 

4431 

4432 

4433 

4434 


uence  attitudes 
of  military  leaders  in  Russia 
In  Bulgaria 
in  Yugoslavia 
In  Romania 

political  leaders  In  Russia 
In  Bulgaria 
in  Yugoslavia 
In  Romania 

of  the  general  population  In  Russia 

In  Bulgaria 
In  Yugoslavia 
In  Romania 


Remove  key  officials 


4511 

by  kidnapping  In  Russia 

.  4512 

In  Bulgaria 

4513 

In  Yugoslavia 

4514 

In  Romania 

4521 

by  assassination  in  Russia 

4522 

in  Bulgaria 

4523 

In  Yugoslavia 

4524 

In  Romania 

4531 

by  encouraging  defection  In  Russia 

4532 

In  Bulgaria 

4533 

In  Yugoslavia 

4534 

In  Romania 

PUBLIC  OPINION  ACTIONS  YOU  CAN  TAKE 


CQllKt  information 

5111  from  U.S.  public  concerning  support  for  U.S.  actions 

5112  for  Soviet  actions 

5121  from  pro-Western  nations  concerning  support  for  U.S.  actions 

5122  for  Soviet  actions 

Disseminate  Information 

5211  to  U.S.  public  concerning  current  U.S.  actions 

5212  Soviet  actions 

5221  to  pro-Uestem  nations  concerning  current  U.S.  actions 

5 222  Soviet  actions 


INFORMATION  SEARCH  YOU  CAN  MAKE 


Ecpnoml c 

6111  Oescribe  the  Importance  of  U.S.  Imports  from  Russia 

6112 

from  Bulgaria 

6113 

from  Yugoslavia 

6114 

from  Romania 

6121 

Oescribe  the  Importance  of  U.S.  exports  to  Russia 

6122 

to  Bulgaria 

6123 

to  Yugoslavia 

6124 

to  Romania 
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YOUR  BECISION  TO  REDUCE  IMPORTS  OF  MANUFACTURED  GOODS  FROM  RUSSIA 
SF  UL. 

Tint -S.5 

PER 108-1  MESSAGES-3 

DECISION  NUMBER-5  TIME-06/ 18  19(50(48 
< (81221.1  ) 

FUTURE  8ECI SIONSt (  (83221 . 1  (D3222. 1  > 

BASED  ON  8ECXSI0NS:0 
BASED  ON  MESSAGES :0 

R32/C0MPLEX  TEST 

rOUF.  DECISION  10  REDUCE  CREDIT  TO  YUGOSLAVIA  BY  1  MILLION  DOLLARS  *!• 

TlME-7 2. 5 

PERiGD-3  HE  S  SAGE  S— 23 

DECISION  NUMBER-3?  TIME-06/19  00(17(25 
< (81331.1  ) 

FUTURE  DECISIONS^ (01111.1 ) 

BASED  ON  DEC 1SIGNS. 35 
BASED  ON  MESSAGES JO 

R33/C0MPLEX  TEST 

YOUR  DECISION  TO  SEND  DIPLOMATS  TO  DISCUSS  POTENTIAL  INVOLVEMENT  OF  U.S. 

N  YUGOSLAVIA  WITH  THE  RUSSIAN  AMBASSADOR  *!-79>75* 

TIME-74 .5 

PERIOD-3  MESSAGES-24 
DECISION  NUMBER-38  TIME- 
\ ( D2231 . 1 ( D2232 . 1 ) 

BAClD  UN  DEC1SI0NS:33(35 
BASED  ON  MESSAGES.O 

R38/L0MPLEX  TEST 

YOUR  DECISION  TO  REDUCE  EXPORTS  OF  HICH  TECHNOLOGY  PRODUCTS  TO  RUSSIA 
uCCESSFULLY  COMPLETED. 

UriE-lO.S 

FEFIDD-1  HESSAGES-4 

DELISIOn  NUMBER-6  T1ME-06/1B  19(53(25 
< (D1121.1  ) 

DASH)  On  DECISIONSIO 
BASED  ON  MESSAGES JO 

R59/C0MPLEX  TEST 

YOUR  DECISION  TO  HOVE  U.S.  AIR  FORCE  INTERCEPTOR  SQUADRONS  (W.  GERM)  TO  AIRFIELD 
S  In  BRI1AIN  HAS  BEEN  SUCCESSFULLY  ACCOMPLISHED.*! 

-51>46tr 

TInt-12.5 

FER10D-1  MESSAGES-5 

DECISION  NUMBER-7  11ME-06/1B  19(55(17 
^  I  *11  Ii3a22  •  1  3 

FUTURE  DECISIONS::  (D3211.KD3212.1X  I H3221 .111*3222. 1  X  ID1311.1  X  (D2121.KD2122.1  > 

BASED  ON  DECISIONS: 3(4 (5 
BASED  On  MESSAGES :0 

R42/C0MPLEX  TEST 

...  ------  10 

IAIN  HAS 


FDKCES  I 


06/19  00(19139 


HAS  BEEN  S 


YOUR  DECISION  TO  MOVE  U.S.  AIR  FORCE  INTERCEPTOR  SOUADRONS  (W.  GERM)  TO  AIRFIELD 
'  N  BRITAIN  HAS  BE -  -  - 


S  If  .... 

>51>46* 

1IME-14.L 

PERIOD-1 


EEN  SUCCESSFULLY  ACCOMPLISHED.*! 
MESSAGES-5 


F-4 


•  ^IN¬ 


DECISION  NUMBER-8  TIME-06/18  19159159 

^URi1ficS'll&Nst<>(D3221.1(D3222.1  > 
BASED  ON  DECISIONS !  7 
BASED  OK  MESSAGES: 5 


BASED  OK  MESSAGES: 5 
R66/COMPLEX  TEST 

TOUR  OECISION  TO  REDUCE  CREDIT  TO  RUSSIA  BT  1  MILLION  DOLLARS  HAS  NOT  SUCCESSFUL. 
TlME-16. 5 

PER  I  Oft*  1  MESSAGES** 

DECISION  NUMBER-9  TIME-06/18  20*04105 
* (01311.1  ) 

FUTURE  DECISIONS:*  (D13U.1X  101331.1) 

BASED  OK  DECISIONS:? 

BASED  ON  messages: 5 
R66 /COMPLEX  TEST 

YOOK  DECISION  TO  SEND  MESSAGES  CONCERNING  THE  POTENTIAL  RESUMPTION  OF  NORMAL  TRAD 
E  TO  THE  RUSSIAN  AMBASSADOR  WAS  NOT  SUCCESSFUL. 

TIME-18.5 

FERlCiD-1  MESSAGES*? 

DECISION  NUMBER*10  TIME-06/18  20(06(55 
< (D2121. 1(02122.1  ) 

FUTURE  DECISIONSSt (01331.1 X 102211 . 1 (02212. 1 > 

BASED  ON  DECISIONS:? 

BASED  ON  MESSAGES :0 

R70/ COMPLEX  TEST 

YOUR  DECISION  TO  MOVE  U.S.  AIR  FORCE  INTERCEPTOR  SDUADRONS  <U.  GERM )  TO  AIRFIELD 
S  IK  BR11A1N  HAS  BEEN  SUCCESSFULLY  ACCOMPLISHED. 8! 

-51>466  .  .. 

TIME-20. 5 

PERIOD-1  MESSAGES-7 

DECISION  NUMBER-11  TIME-06/18  20(09(53 
( (03221. 1(03222.1 > 

FUTURE  DECISIONS:* (03211.1(03212.1 > 


BASED  OK  DECISIONSJB 
BASED  ON  MESSAGES SO 


R7o/C0MPLEX  TEST 

YOUF:  DECISION  TO  REDUCE  CREDIT  TO  RUSSIA  BY  1  MILLION  DOLLARS  NAS  NDT  SUCCESSFUL 
TIME-22. 5 

PERIOD-1  HESSAGES-B 

DECISION  NUMBER-12  TIME-06/18  20(12(29 
< 101311.1  ) 

based  on  decisions:? 

BASED  ON  MESSAGES SO 
R76/C0MPLEX  TEST 

YOUR  DECISION  TO  REDUCE  CREDIT  TO  BULGARIA  BY  1  MILLION  DOLLARS  HAS  BEEN  SUCCESS 

FULLY  COMPLETED. 8 !-28>248 

TIME-24.5 

PERIOD-1  MESSAGE6-9 

DECISION  NUMBER-13  TIME-06/18  20(14(25 
< (D1321.1 > 

BASED  ON  DEC1SX0NS.0 
BASED  ON  MESSACESIO 

R64/C0MPLEX  TEST 

YOUR  DECISION  TO  ARRANGE  A  CONFERENCE  WITH  CABINET  MEMBERS  TO  PLAN  FUTURE  POLITI 
CAL  APT  IONS  HAS  NOT  SUCCESSFUL. 

TIME-26.5 

PERIOD-!  MESSAGES-? 

DECISION  NUMBER-14  TIME-06/18  20(16(51 
< (02321.1 ) 

FUTURE  DECISIONS:* ID2321.1 X (D3111.1 > 

BASED  ON  DECISIONS^ 

BASED  ON  MESSAGES :0 

RS6/C0MPLEX  TEST 

YOUR  DECISION  TO  REDUCE  EXPORTS  OF  FOOD  TO  RUSSIA  HAS  BEEN  SUCCESSFULLY  COMPLETE 

D. 

TIME-28. 5 

PERIOD-1  MESSAGES- 10 

DEL I SI ON  NUMBER-15  TIME-06/18  20(19(50 


<  (Dim.!> 

BASED  ON  DECISX0NS:0 

Based  on  messages:? 


t\v 


m 


£ 


■*? 


V, 


A 


y. 


v. 


y. 


NVN 


RBS/COHFLEX  TEST 

YOUR  DECISION  TO  HOVE  U.S.  SIXTH  FLEET 
N  SUCCESSFULLY  ACCOMPLISHED.* ! »2>20B 
TIME-30. 5 

PERIOD-2  MESSAGES-! 1 

I'ECISION  NUMI'ER-IA  TIME-06/1B  21150(59 
<  ID3211  •  1 ID3212.1  > 

FUTURE  DECISIONSJi (D12U.1 ) 

BASES  OKI  I'EC1SI0NS:7(11 
BASES  ON  MESSAGES SO 


TASK  FORCE  A  TO  THE  ADRIATIC  SEA  HAS  BEE 


NUMBER  OF  CATEGORIES- 
111 
112 
121 
122 

131 

132 

133 
211 


19 


212 

213 

221 


2*-» 

231 

232 

311 

$22 

411 


PER  101'  1 
1 -MEASURE- 


(*  OF  DECISIONS) 

2- HEASURE-5  333  <♦  OF  RESPONDENT  DEC.) 

3- MEASURE- 10  (•  OF  DEC.  CATEGORIES) 

4- MEASURE-13  BAX  (•  OF  FWD  INTEGRATIONS) 

5- MEASURE- 133  68oS  '  < HULTIPLEXITY  F) 

6- MEASURE-UA  MINUTES  (WEIGHT) 

7- MEASURE-O  OX  ( t  OF  BKH  INTEC) 
B-MEASURE-2  13X  (♦  OF  UNINTEC.RES.DEC.  ) 

9- hEASURE-562  (816) 

1 0- MEASURE- X95X  (WEIGHTED  BIS) 

11- MEASURE-2.9  ( AVE. RESPONSE  SPEED) 

12- MEASURE-4  (SERIAL  CONNECTIONS) 

1 3- MEASURE- 1  (PLANNED  INTEGRATIONS) 

14- MEASURE-4  (GENERAL  UNINTEGRATED  DEC.) 


PERIOD  2 

l-MEASURE-16  (•  OF  DECISIONS) 


2- MEASURE-3  1BX  (t  OF  RESPONDENT  DEC.) 

3- MEASURC-14  (•  OF  DEC.  CATEGORIES) 

4- MEASURE-12  75X  (•  OF  FWD  INTEGRATIONS) 

5- MEASURE *ooX  < MULTIPLEXITY  F> 
4-MEASURE- 1 84  MINUTES  (WEIGHT) 
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7-HEASURE-2  X2X  <  •  OF  *KD  XNTEC  > 
B-MEABURE*3  1BX  (•  OF  UNXNTEC.RES.OEC. > 

9- MEASURE-X312  (OXS) 

10—  M£ASURE*36'4  (WEIGHTED  0X6 » 

Xl-HEASUFcE*3. 63333333  ( AVE. RESPONSE  SPEEI*  > 
X2-MEASURE-0  (SERIAL  CONNECTIONS) 

13- MEASURE-O  (PLANNED  INTEGRATIONS  ) 

14- MEASURE*2  (GENERAL  UNINTECRATED  DEC.) 
PERIOD  3 

1- MEASURE-7  (•  OF  DECISIONS) 

2- MEASURE-2  2BX  (•  OF  RESPONDENT  DEC.) 

3- MEASURE-7  («  OF  DEC.  CATEGORIES) 

4- MEASURE-4  57 X  (•  OF  FUD  INTEGRATIONS ) 

5- HEASURE«6  05X  ( HULTXPLEXXTY  F) 
A-HEASUKE-22  MINUTES  (  HEIGHT ) 

7-MEASURE-O  OX  (•  OF  DKD  XNTEC ) 
B-MEASURE-1  14X  (•  OF  UNXNTEC.RES.DEC. ) 

9- MEASURE-134  (BIS) 

10- MEASURE-41Z  ( WEIGHTED  0X6) 

1 1 - MEASURE* .5  (  AVE .RESPONSE  SPEED  ) 

12- MEASURE-0  (SERIAL  CONNECTIONS) 

13- MEASURE*3  (PLANNED  INTEGRATIONS) 

1 4 - ME ASURE*2  (GENERAL  UNINTEGRATED  DEC.) 


F-7 


APPENDIX  G 

DETAILED  EXPLANATIONS 
OF  THE  14  MEASURES 
OF  DECISION  MAKING 


The  purpose  of  this  appendix  is  to  provide  complete  definitions  of  the 
14  measures  of  decision-making  strategy  calculated  by  the  computer  for 
each  simulation  period.  This  appendix  provides  more  detail  than  that 
given  In  the  body  of  the  report;  It  explains  the  calculation  of  measures 
on  the  "Complex  Test"  sample  participant.  That  profile  is  presented  in 
Appendix  F. 

The  14  measures  are  calculated  by  the  computer  using  the  data  stored 
for  each  decision.  These  data  are  printed  out  If  the  data  list  option 
is  selected.  The  majority  of  the  Complex  Test  printout  in  Appendix  F 
is  the  data  list  section.  Pertinent  data  from  the  data  list  section 
appear  in  Table  A. 

Using  the  data  In  Table  At  a  diagram  called  a  time-event  matrix  was  con¬ 
structed  and  Is  presented  In  Figure  A.  This  matrix  contains  a  point  for 
each  decision  and  clearly  shows  decision  connections.  The  horizontal  axis 
Is  time,  the  vertical  axis  is  decision  category.  Forward  Integrations 
are  noted  by  diagonal  lines  with  a  forward  arrow  -»►,  backward  integra¬ 
tions  are  diagonals  with  a  backward  arrow  serial  connections  are 
horizontal  lines  with  a  forward  arrow ■►.  The  sample  calculations  in 
this  appendix  will  refer  to  Table  A  and  Figure  A. 

Number  of  decisions  (Measure  1)  is  the  total  number  of  decisions  executed 
within  a  simulation  period.  To  score  a  decision,  a  participant  must: 

•  Enter  the  decision  code. 

•  Execute  the  decision  (by  pressing  RETURN 
when  the  computer  asks  if  the  decision 
should  be  executed) 

Every  decision  Is  counted  even  if  the  same  decision  is  executed  more  than 
once. 

As  shown  In  Table  A  and  Figure  A,  15  decisions  were  executed  during  period  1, 
16  In  period  2,  and  7  In  period  3.  The  category  numbers  of  the  decisions  are 
also  available  In  Table  A  and  figure  A. 
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TABLE  A 

DATA  FOR  SAMPLE  PARTICIPANT  "COMPLEX  TEST" 
(Adapted  from  Unger  and  Swezey,  1983) 


DECISION  # 

DECISION 

CATEGORY 

BASED  ON 
MESSAGE 

PLANNED 

DECISIONS 

BASED  ON 
DECISION  # 

TIME  DECISION 
EXECUTED 

PERIOD  1: 

1 

111 

1 

1121 

• 

.5 

2 

112 

1 

3211,  3212 

1 

2.5 

3 

321 

* 

1211,  3221, 
3222 

2 

4.5 

•  4 

121 

3221,  3222 

3 

6.5 

5 

122 

tm 

3221,  3222 

- 

8.5 

6 

112 

- 

- 

- 

10.5 

7 

322 

3211,  3212, 
3221,  3222, 
1311,  2121, 
2122 

3,  4,  5 

12.5 

8 

322 

5 

3221,  3222 

7 

14.5 

9 

131 

5 

1311,  1331 

7 

16.5 

10 

212 

• 

1331,  2211, 
2212 

7 

18.5 

'  11 

322 

- 

3211,  3212 

8 

20.5 

12 

131 

• 

- 

9 

22.5 

13 

132 

- 

- 

24.5 

14 

232 

- 

2321,  3111 

- 

26.5 

15 

111 

9 

- 

- 

28.5 

PERIOD  2: 

16 

321 

_ 

1211 

7.  11 

30.5 

17 

133 

- 

1211 

9,  10 

32.5 

18 

211 

- 

- 

- 

34.5 

19 

112 

- 

1211 

mm 

36.5 

20 

213 

- 

1321 

mm 

38.5 

21 

221 

mk 

1321 

- 

40.5 

22 

222 

- 

1321 

• 

42.5 

23 

122 

13 

- 

15,  18 

44.5 

24 

231 

14 

- 

• 

46.5 

25 

211 

14 

- 

- 

48.5 

26 

311 

• 

3221,  3222 

14 

50.5 

27 

121 

. 

3221,  3222 

16,  17,  19 

52.5 

28 

111 

. 

3221,  3222 

- 

54.5 

29 

132 

• 

3221,  3222 

20,  21.  22 

56.5 

30 

232 

• 

3221,  3222 

14 

58.5 

31 

111 

- 

3221,  3222 

- 

60.5 

PERIOD  3: 

32 

211 

18 

•» 

• 

62.5 

33 

411 

19 

2231,  2232 

- 

64.5 

34 

112 

• 

1221 

- 

66.5 

35 

322 

• 

1211,  1331, 
2231,  2232 

26,  27,  28, 
29,  30,  31 

68.5 

36 

121 

- 

1111 

35 

70.5 

37 

133 

• 

1111 

35 

72.5 

38 

223 

- 

- 

33,  35 

74.5 
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Figure  A.  Time-event  matrix  for  sample  participant  "Complex  Test"  (adapted  from  Unger  and  Swezey,  1983) 


Number  of  respondent  decisions  (Measure  2)  is  the  total  number  of  decisions 
executed  within  a  simulation  period  based  on  a  previous  message.  To  score 
a  respondent  decision,  a  participant  must: 


•  Execute  a  decision 

•  Report  that  the  decision  was  based  on 
a  previous  message  or  messages 

If  one  decision  was  based  on  two  messages,  then  two  respondent  decisions 
are  scored  for  that  one  decision,  and  so  forth.  Thus,  the  number  of 
respondent  decisions  may  exceed  the  total  number  of  decisions. 

From  Table  A,  we  see  that  five  respondent  decisions  were  executed  in  period  1 
(with  category  numbers  111,  112,  322,  131,  and  111).  We  calculate  this  by 
counting  the  number  of  decisions  reported  to  be  based  on  a  message,  counting 
each  decision  once  for  as  many  messages  on  which  it  is  based.  Table  A  shows 
three  respondent  decisions  in  period  2,  and  two  in  period  3. 

Also  for  Measure  2,  the  printout  gives  the  proportion  of  respondent  to  total 
decisions;  in  this  case,  5/15  or  33%  for  period  1,  3/16  or  18%  for  period  2, 
and  2/7  or  28%  for  period  3. 

Number  of  decision  categories  (Measure  3)  is  the  total  number  of  decision 
categories  used  within  a  simulation  period.  As  described  thoroughly  in  the 
body  of  the  report,  a  decision  category  is  the  first  three  digits  of  a 
decision  code,  or  a  decision  choice  sequence  through  the  first  three  choice 
options.  Decisions  coded  1211  and  1213  are  in  the  same  category  (121),  but 
decisions  coded  1211  and  1221  are  in  different  categories.  The  decision 
category  of  each  executed  decision  is  scored  only  once  no  matter  how  often 
it  is  selected  within  a  period. 

From  Table  A,  we  see  the  decision  categories  selected  in  order  in  period  1 
are:  111,  112,  321,  121,  122,  112  (already  selected),  322,  322  (already 
selected),  131,  212,  322  (already  selected),  131  (already  selected),  132, 

232,  and  111  (already  selected)  for  a  total  of  10  categories  used  in  period  1 


The  14  categories  In  period  2  are  scored  for  each  decision  except  decision 
numbers  25  and  31  whose  categories  were  already  scored. 

Each  decision  in  period  3  fell  In  a  different  category  for  a  total  of  seven. 

Number  of  forward  integrations  (Measure  4)  is  the  total  number  of  forward 
integrations  originating  within  a  period.  The  integrations  may  be  com¬ 
pleted  within  the  period  of  origination  or  in  a  later  period.  To  score  a 
forward  integration,  a  participant  must: 

•  Execute  a  decision 

•  Plan  a  future  decision  in  another 
decision  category 

t  Execute  the  planned  decision  (or 
any  decision  In  the  same  category 
as  the  planned  decision) 

•  Report  that  the  planned  decision 
was  based  on  the  previous  decision 

To  calculate  number  of  forward  Integrations  from  Table  A,  we  start  at 
decision  1,  code  111.  At  the  time  of  execution,  decision  112  (in  a 
different  category  from  111)  was  planned,  later,  at  decision  2,  112 
was  executed,  and  the  participant  reported  that  decision  112  was  based  on 
previous  decision  1  (which  Is  decision  111).  Thus,  the  forward  inte¬ 
gration  Is  complete. 

From  Table  A,  we  count  the  following  forward  integrations:  decision  1  to  2, 
2  to  3,  3  to  4,  3  to  7,  4  to  7,  5  to  7  (7  to  8  does  not  count  because  both 
are  in  the  same  category),  7  to  9,  7  to  10,  7  to  16,  (8  to  11  does  not  count 
because  they  are  In  the  same  category;  9  to  12  is  also  within  a  category), 

9  to  17,  10  to  17,  11  to  16,  and  14  to  26  (14  to  30  is  within  a  category). 

It  Is  easy  to  count  forward  Integrations  from  Figure  A.  Simply  count  the 
diagonals  with  a  forward  arrow.  (Horizontal  lines  do  not  count  because 
they  connect  within  category  decisions).  Using  Figure  A,  the  12  forward 
integrations  in  period  2  are  17  to  27,  16  to  27,  19  to  27,  20  to  29, 


21  to  29,  22  to  29,  26  to  35,  30  to  35,  27  to  35,  29  to  35,  28  to  35,  and 
31  to  35.  In  period  3,  the  four  forward  integrations  are  35  to  36,  35  to  37, 
35  to  38,  and  33  to  38. 

Also  for  this  measure,  the  printout  includes  the  proportion  of  forward  inte¬ 
grations  to  total  decisions.  For  period  1,  this  ratio  is  13/15  or  86%; 
for  period  2,  12/16  or  75%;  for  period  3,  4/7  or  57%. 

Multiplexity  F  (Measure  5)  is  the  sum  of  the  count  of  each  forward  integra¬ 
tion  scored  within  a  period,  plus  all  forward  integrations  originating  and 
ending  in  the  endpoint  of  each  forward  integration,  plus  all  forward  inte¬ 
grations  originating  (not  ending)  in  the  endpoint  of  subsequent,  directly 
connected  Integrations  leading  to  the  end  of  the  simulation. 

Multiplexity  F  reflects  future  planning.  As  any  one  Integration  leads  to 
other  integrations,  multiplexity  increases.  Three  sample  calculations 
follow. 

The  sample  below  appeared  in  the  body  of  the  report  and  is  repeated  here 
for  reader  convenience.  The  sample  below  diagrams  seven  connected  forward 
integrations  (Indicated  by  the  arrow  at  the  end  of  the  diagonals).  For 
example,  decision  C  was  planned  at  decisions  A  and  B,  and  when  C  was 
executed.  It  was  reported  based  on  A  and  B. 

Category 

111 
121 
123 

131 

132 
211 
222 
223 
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We  will  use  this  diagram  to  explain  the  calculation  of  Multi  pi exity  F  for 
integration  BC. 

BC+AC+CD+CE+EF+FG  =  6 

HG  does  not  count  because  it  ends,  not  begins,  at  the  endpoint  of  the 
forward  integration  FG,  which  is  not  the  integration  of  interest.  AC 
counts  because,  for  the  integration  of  interest,  BC,  all  integrations 
connected  to  its  endpoint  are  connected.  If  all  seven  integrations  were 
scored  in  one  period,  the  total  for  the  period  would  be  the  sum  of  the 
values  for  each  integration. 

To  calculate  Multiplexity  F  for  period  3  in  the  sample,  refer  to  the  time 
event  matrix  (Figure  A)  and  to  Table  B. 

Period  2  of  the  sample  provides  a  more  complex  example.  See  Table  C. 

Weight  or  integration  time  weight  (Measure  6)  is  the  sum  of  the  time  elapsed 
from  initial  to  endpoint  decision  for  each  forward  integration  scored  in  a 
period.  Time  in  this  measure  is  real  minutes  of  simulation  time.  For  example, 
if  time  from  original  decision  A  to  planned  and  executed  endpoint  decision  C 
is  three  minutes,  and  from  decision  B  to  planned  decision  D  is  five  minutes, 
the  weight  is  eight  minutes  (even  if  AC  and  BD  overlap  in  time).  Backward 
integrations  (see  Measure  7)  are  not  counted  in  this  measure. 

Weight  may  be  easily  calculated  using  the  data  in  Table  A.  For  period  1, 
weight  for  the  13  forward  integrations  credited  to  period  1  is  calculated 
in  Table  D. 

Number  of  backward  integrations  (Measure  7)  is  the  total  number  of  backward 
integrations  originating  in  a  period.  The  backward  integration  may  or  may 
not  end  in  the  same  period.  To  score  a  backward  integration,  the  participant 
must: 

•  Enter  a  decision  A  (endpoint  decision) 

•  Not  enter  plans  to  execute  decision  B 
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TABLE  B 


FORWARD 

SCORED 


MULTIPLEXITY  F  CALCULATION  FOR  PERIOD  3 
FOR  SAMPLE  PARTICIPANT  "COMPLEX  TEST" 


INTEGRATIONS 
IN  PERIOD  3 


ALL  FORWARD 
INTEGRATIONS 
DIRECTLY  CONNECTED 
TO  THE  ENDPOINT 


FORWARD  INTEGRATIONS 
ORIGINATING  AT  THE 
ENDPOINT  OF 
SUBSEQUENT  CONNECTED 
INTEGRATIONS 


CALCULATIONS 


TABLE  C 

MULTIPLEXITY  F  CALCULATION  FOR  PERIOD  2 
FOR  SAMPLE  PARTICIPANT  "COMPLEX  TEST" 


FORWARD  INTEGRATIONS  ALL  FORWARD  FORWARD  INTEGRATIONS  CALCULATIONS 

SCORED  IN  PERIOD  2  INTEGRATIONS  ORIGINATING  AT  THE 

DIRECTLY  CONNECTED  ENDPOINT  OF 

TO  THE  ENDPOINT  SUBSEQUENT  CONNECTED 
_  _  INTEGRATIONS 


17-27 

16-27 

19-27 

27-35 

35-36 

35-37 

35-38 

7 

16-27 

17-27 

19-27 

27-35 

35-36 

35-37 

35-38 

7 

19-27 

16-27 

17-27 

27-35 

35-36 

35-37 

35-38 

7 

20-29 

21-29 

22-29 

29-35 

35-36 

35-37 

35-38 

7 

21-29 

20-39 

22-29 

29-35 

35-36 

35-37 

35-38 

7 

22-29 

20-29 

21-29 

29-35 

35-36 

35-37 

35-38 

7 

26-35 

30-35 

27-35 

29-35 

28-35 

31-35 

35-36 

35-37 

35-38 

9 

30-35 

26-35 

27-35 

29-35 

28-35 

31-35 

35-36 

35-37 

35-38 

9 

27-35 

26-35 

30-35 

29-35 

_ 

28-35 

31-35 

35-36 

35-37 

35-38 

9 

29-35 

26-35 

30-35 

27-35 

28-35 

31-35 

35-36 

35-37 

35-38 

9 

28-35 

26-35 

30-35 

27-35 

29-35 

31-35 

35-36 

35-37 

35-38 

9 

31-35 

26-35 

30-35 

27-35 

_ 

29-35 

28-35 

35-36 

35-37 

35-38 

9 

TOTAL  =  96 
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TABLE  D 


INTEGRATION  TIME  WEIGHT  CALCULATIONS 
FOR  PERIOD  1  FOR  SAMPLE 
PARTICIPANT  "COMPLEX  TEST" 


FORWARD  INTEGRATIONS  TIME  OF  EXECUTION* 
IN  PERIOD  1 


TIME  ELAPSED  IN 
REAL  MINUTES  OF 
SIMULATION  TIME 


Origin 

Decision 

Endpoint 

Decision 

Origin 

Decision 

Endpoint 

Decision 

1 

2 

.5 

2.5 

2 

2 

3 

2.5 

4.5 

2 

3 

4 

4.5 

6.5 

2 

3 

7 

4.5 

12.5 

8 

4 

7 

6.5 

12.5 

6 

5 

7 

8.5 

12.5 

4 

7 

9 

12.5 

16.5 

4 

7 

10 

12.5 

18.5 

6 

7 

16 

12.5 

30.5 

18 

11 

16 

20.5 

30.5 

10 

9 

17 

16.5 

32.5 

16 

10 

17 

18.5 

32.5 

14 

14 

26 

26.5 

50.5 

24 

z  =  TT6 

$ 

i 

%  j 

'.v 

w 

W 

fr: 

1 


¥ 


♦All  execution  times  in  this  sample  happen  to  fall  on  even 
minutes  and  at  half  minutes;  however,  the  computer  registers 
execution  times  at  any  tenth  of  any  minute.  (From  Unger 
and  Swezey,  1983) 
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£ 


G-IO 


•  Execute  decision  6  (the  origin  decision) 

In  a  different  category  from  decision  A 

•  Report  that  decision  B  was  based  In  part 
on  decision  A 

Note  that  backward  Integrations,  unlike  forward  integrations,  originate 
at  a  time  later  than  their  endpoints.  Both  forward  and  backward  integra¬ 
tions,  however,  are  credited  to  the  period  during  which  they  originated. 

It  is  easier  to  calculate  backward  Integrations  from  the  time-event  matrix 
in  Figure  A  than  from  Table  A.  On  the  matrix,  a  backward  Integration  is 
a  diagonal  with  a  backward  arrow  pointing  to  the  endpoint.  There  are  no 
backward  integrations  in  periods  1  and  3  of  the  sample.  Period  2  has  two 
backward  integrations,  23  to  15  and  23  to  18. 

Unintegrated  respondent  decisions  (Measure  8)  is  the  total  number  of 
unintegrated  respondent  decisions  within  a  period.  An  unintegrated 
respondent  decision  occurs  in  response  to  a  message,  but  may  not  originate 
a  forward  integration.  An  unintegrated  respondent  decision  may,  however, 
be  part  of  a  backward  integration,  or  the  endpoint  of  a  forward  Integration, 
and  it  may  lead  to  another  decision  in  the  same  category.  Unintegrated 
respondent  decisions  are  a  special  case  of  respondent  decisions  because 
general  respondent  decisions  may  be  any  part  of  an  integration.  To  score 
an  unintegrated  respondent  decision,  a  participant  must: 

•  Execute  decision  A  (A  may  be  planned  or 
not  planned) 

•  Report  that  decision  A  was  based  on  a 
previous  message 

AND  EITHER 

e  At  the  time  decision  A  Is  executed,  not 
report  a  decision  plan  in  a  different 
category 

OR 

e  Report  a  decision  plan  in  a  different 
category,  execute  the  plan,  but  not 
report  It  based  on  decision  A 


In  order  to  calculate  number  of  unintegrated  respondent  decisions  we 
need  more  information  than  is  shown  on  the  time-event  matrix,  so  we  use 
Table  A.  We  will  first  find  all  the  respondent  decisions,  then  test  to 
see  if  they  originate  forward  integrations  which  will  exclude  them  from 
being  "unintegrated." 

For  period  1,  the  respondent  decisions  are  1,  2,  6,  9,  and  15.  Decisions 
1  and  2  originate  forward  integrations  so  they  are  not  unintegrated. 

Decision  8  leads  only  to  a  decision  in  its  own  category  so  it  is  uninte¬ 
grated.  Decision  9  originates  a  forward  integration.  Decision  15  does 
not  originate  a  forward  integration  and  is  unintegrated.  Thus,  Decisions 
8  and  15  are  the  only  two  unintegrated  respondent  decisions  in  period  1. 

For  period  2,  the  respondent  decisions  are  numbers  23,  24,  and  25.  None 
of  them  originates  a  forward  integration  and  are  all  unintegrated  according 
to  the  use  of  the  word  unintegrated  in  this  measure.  Decision  23  originates 
two  backward  integrations,  but  still  counts  as  unintegrated. 

For  period  3,  the  respondent  decisions  are  32  and  33.  Decision  33  originates 
a  forward  integration;  32  is  an  unintegrated  respondent  decision. 

QIS  or  quality  of  Integrated  strategies  (Measure  9)  is  the  sum  of,  for  each 
forward  Integration  scored  In  a  period,  the  time  weight  for  that  integration 
multiplied  by  the  sum  of  the  number  of  forward  integrations  originating  and 
ending  at  the  origin  and  endpoint  of  the  forward  Integration  plus  one  for 
that  forward  Integration. 

QIS  may  be  thought  of  as  reflecting  the  complexity  of  plans  at  any  point. 
Where  plans  are  connected  in  a  strategy,  QIS  is  high.  The  QIS  score  is 
low  where  integrations  are  not  connected.  QIS  also  increases  with  the 
time  interval  from  origin  to  endpoint  of  Integration.  Two  samples  of  QIS 
calculations  follow. 
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V. 


The  sample  below  was  used  In  the  body  of  the  report.  If  vector  AB  is  a 
forward  Integration,  and  forward  integration  vectors  CA  and  DA  end  at 
decision  A  In  AB,  and  AE  originates  at  A  in  AB,  and  forward  Integration 
vectors  BF  and  BG  originate  at  B  In  AB,  and  HB  ends  at  B  in  AB,  and  the 
time  elapsed  from  A  to  B  is  four  minutes,  the  QIS  score  is  four  (the 
time  weight)  multiplied  by  the  sum  one  for  AB  plus  three  for  CA,  DA,  and 
AE,  plus  three  for  BF,  BG,  and  HB,  or  4(7)  or  28. 

Category 
111 
121 
123 
131 
211 
222 
232 
311 

Period  3  of  the  sample  provides  a  more  complex  example  of  the  QIS  calculation. 
To  calculate  QIS  for  period  3  In  the  sample,  refer  to  the  time-event  matrix 
and  Table  E. 

Weighted  QIS  (Measure  10)  is  the  sum  of  each  forward  Integration  scored  in 
a  period,  plus  all  forward  Integrations  originating  and  ending  at  both  ends 
of  the  forward  Integration,  plus  all  forward  Integrations  originating  (not 
ending)  In  the  endpoint  of  subsequent,  directly  connected  Integrations 
until  the  end  of  the  simulation,  plus  all  forward  integrations  ending  (not 
originating)  in  the  origin  of  previous  directly  connected  Integrations  until 
the  beginning  of  the  simulation,  multiplied  by  the  time  weight. 

Weighted  QIS  and  QIS  are  equal  when  the  strategy  employed  links  only  three 
or  two  decisions  together;  that  Is,  one  forward  Integration  linked  to  one 
other  forward  Integration,  or  just  one  forward  Integration  not  connected 
to  any  other  Integration. 


QIS  •  WQIS 


However,  if  four  decisions  or  three  forward  integrations  are  linked, 
weighted  QIS  increases  over  QIS  because  weighted  QIS  considers  all 
forward  integrations  linked  from  beginning  to  end  of  simulation,  and 
QIS  considers  only  those  directly  adjoined  to  any  one  forward  integration: 

1 

WQIS  > QIS 

Two  sample  calculations  follow.  The  first  example  was  used  in  the  body 
of  the  report.  Refer  to  the  diagram  below. 


If  vector  AB  Is  a  forward  integration,  and  forward  integration  CA  connects 
to  A  in  AB,  and  DC  connects  to  C  in  CA,  and  CE  connects  to  C  in  CA,  and  BF 
and  HB  connect  to  B  in  BA,  and  GF  connects  to  F  in  BF,  and  time  elapsed 
from  A  to  B  Is  five  minutes,  the  weighted  QIS  score  is  five  multiplied  by 
the  sum  of  one  for  AB  plus  one  each  for  CA  and  DC  (not  CE  which  originates 
not  ends  In  DC  and  CA),  plus  one  each  for  HB  and  BF  (not  GF  which  ends  not 
originates  In  BF),  or  5(5)  ■  25.  Weighted  QIS  is  not  QIS  multiplied  by 
the  integration  time  weight  as  the  name  might  imply.  It  is  QIS  (which 
already  includes  time  weight)  weighted  with  integrations  distally  connected 
to  a  target  integration. 


[The  QIS  score  for  the  above  sample  would  be  five  times  (1  for  AB  +  1 
for  CA  +  1  for  BF  +  1  for  HB)  B  5(4)  =  20.  The  Multiplexity  F  for  the 
sample  would  be  one  for  AB  plus  one  for  HB  plus  one  for  BF  or  three. 
Multiplexity  F  Is  essentially  the  forward  half  of  WQIS  minus  the  time 
weight.] 

WQIS  for  period  3  of  the  sample  provides  a  more  complex  example.  Refer 
to  the  time-event  matrix  in  Figure  A  and  Table  F. 

Average  response  speed  (Measure  11)  is  the  average  time  (in  real  minutes 
of  simulation  time)  elapsed  between  receipt  of  a  message  and  subsequent 
execution  of  a  respondent  decision.  (Recall  that  a  respondent  deicsion 
is  one  the  participant  reports  was  based  on  a  previous  message.  See 
Measure  2.)  The  calculation  Is  based  on  every  respondent  decision  within 
a  period. 

To  calculate  average  response  speed  for  period  1  in  the  sample,  refer  to 
Table  A  and  Table  G. 

Number  of  serial  connections  (Measure  12)  is  the  number  of  serial  connections 
scored  in  one  period.  A  serial  connection  would  be  identical  to  an  integra¬ 
tion  (see  Measures  4  and  7)  except  that  decisions  connected  serially  fall 
In  the  same  decision  category,  whereas  integrated  decisions  fall  in  different 
decision  categories. 

A  serial  connection  may  be  either  forward  or  backward;  this  measure  Includes 
both  types.  To  score  a  serial  connection,  the  participant  must: 

•  Execute  decision  A 

•  Plan  decision  B  In  the  same  category 

•  Report  that  decision  B  was  based  on 
decision  A 

OR 

•  Execute  decision  A 


*35-36“ and  35-37  do  not  count  because  they  connect  origin  to  origin 
**14-30  Is  a  serial  connection,  not  an  Integration 

'**9-12  does  not  count  because  (a)  it  Is  an  origin-origin  connection  and  fb)  it  Is  serial 
'**7-8  and  8-11  are  serial  connections 


TABLE  G 


AVERAGE  RESPONSE  SPEED  CALCULATION 
FOR  PERIOD  1  FOR  SAMPLE 
PARTICIPANT  "COMPLEX  TEST" 
(from  Unger  and  Swezey,  1983) 


RESPONDENT 

DECISION 

TIME  MESSAGE 
DELIVERED* 

TIME  RESPONDENT 
DECISION  EXECUTED 

RESPONSE  SPEED 

1 

0 

.5 

.5 

2 

0 

2.5 

2.5 

8 

12 

14.5 

2.5 

9 

12 

16.5 

4.5 

15 

24 

28.5 

4.5 

E  14.5 

x  *  2.9 

♦Messages  In  period  1  appeared  every  three  real  minutes  of  si 


t  Not  plan  decision  B 

•  Execute  decision  B  in  the  same  category 
as  decision  A 

•  Report  that  decision  B  was  based  on 
decision  A 

A  serial  connection  in  a  forward  direction  is  credited  to  the  period  of  the 
origin  decision  even  if  the  endpoint  occurs  in  a  different  period.  A 
serial  connection  in  a  backward  direction  is  also  credited  to  the  period  of 
the  origin  decision,  but  in  this  type  of  connection,  the  origin  decision 
occurs  after  the  endpoint  decision  because  the  endpoint  is  designated  only 
retrospectively. 

We  can  count  serial  connections  in  period  1  of  the  sample  by  counting  the 
horizontal  (not  diagonal)  lines  with  forward  or  backward- a-rrows  in  the 
time-event  matrix  (Figure  A).  The  serial  connections  are  decisions  7  to  8, 
8  to  11,  9  to  12,  and  14  to  30.  There  are  no  serial  connections  in  periods 
2  and  3. 

Planned  integrations  (Measure  13)  is  the  number  of  forward  integrations 
planned  but  not  executed  any  time  before  the  end  of  the  simulation.  If 
the  integration  is  accomplished  at  any  time,  even  in  a  later  period  than 
the  origin  decision.  It  is  considered  an  executed  integration.  Planned 
but  not  executed  Integrations  are  credited  to  the  period  in  which  the 
origin  decision  was  entered.  The  planned  decision  must  be  in  a  different 
decision  category  from  the  origin  decision  category.  To  score  a  planned 
but  not  executed  integration,  the  participant  must: 

•  Execute  decision  A 

•  Plan  decision  B  In  another  category 

AND  EITHER 

•  Not  execute  decision  B 

OR 

•  Execute  decision  B  (or  any  decision  in 

B  category)  but  not  report  that  decision 
B  was  based  on  decision  A 
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To  calculate  planned  but  not  executed  integrations,  refer  to  Table  A. 

In  period  1,  when  decision  1  was  executed,  decision  1121  was  planned. 

In  a  different  category  from  origin  decision  1111.  Decision  1121  was 
executed  (decision  2)  and  it  was  reported  based  on  decision  1.  Thus, 
the  integration  was  executed  and  does  not  count  in  this  measure.  We 
check  each  planned  decision  in  this  way  to  see  If  It  was  executed. 

At  decision  10  (212),  we  see  that  decisions  1331,  2211,  and  2212  were 
planned.  Decision  1331  was  executed  in  period  2  (decision  17),  reported 
based  on  decision  10  and,  thus,  the  integration  was  accomplished. 

Decision  2211  (planned  at  decision  212  and  in  a  different  category)  was 
executed  in  period  2  (decision  21)  but  was  not  reported  based  on 
decision  10;  therefore,  one  planned  but  not  executed  Integration  is  scored. 
Planned  decision  2212  was  never  executed,  but  is  not  scored  as  such 
because  it  Is  in  the  same  category  as  planned  but  not  executed  decision 
2211  mentioned  above. 

Period  2  contains  no  planned  but  not  executed  integrations.  Decision  1211 
was  planned  three  times,  executed  at  decision  27,  and  reported  based  on 
the  appropriate  decisions,  so  three  Integrations  scored.  Decision  1321  was 
planned  but  also  executed  three  times.  The  12  plans  at  decisions  26  through 
31  are  all  In  the  same  322  category,  and  when  decision  3221  (decision  35) 
was  executed  It  was  reported  based  on  decisions  26,  27,  28,  29,  30,  and  31. 
Thus,  six  more  integrations  scored  in  period  2  (easy  to  see  on  the  time-event 
matrix). 

Period  3  contains  three  planned  but  not  executed  integrations:  1221,  1111, 
and  1111. 

General  unintegrated  decisions  (Measure  14)  is  the  number  of  general 
unintegrated  decisions  within  a  period.  A  general  unintegrated  decision 
Is  a  decision  which  Is  not  part  of  a  forward  or  backward  Integration.  It 
may  be  part  of  a  serial  connection,  or  it  may  be  respondent,  or  planned 
but  not  executed,  or  planned,  executed,  but  not  reported  based  on  the 
previous  decision,  or  isolated  completely.  Unintegrated  respondent  decisions 
and  planned  but  not  executed  Integrations  are  subsets  (may  be  overlapping) 
of  general  unintegrated  decisions. 
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Genera]  unintegrated  decisions  are  easy  to  spot  on  the  time-event  matrix. 
In  period  1,  decisions  6  and  13  stand  alone;  8  and  12  are  part  of  serial 
connections  not  integrations.  Every  other  decision  in  period  1  is  part 
of  an  integration.  In  periods  2  and  3,  decisions  24,  25,  32,  and  34 
stand  alone.  Every  other  decision  is  part  of  an  integration. 


